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ABSTRACT 


This thesis is based upon lecture notes from a 
course non-equilibrium physics taught by Dr. H. J. Kreuzer 
from 1974-1976 at the University of Alberta. My choice of 
topics reflects tne emphasis whicn he put on various 
aspects of the theory in his course. 

Part One is concerned with the thermodynamics of 
irreversible processes. Tne well-estabdlisned linear theory 
is studied in some detail in Chapters Two and Three in 
which balance equations for mecnanical and thermodynamic 
quantities are determined and the linear phenomenological 
faws relating torces, (to "hiuxes: aresestudied.. Ar fatrrly 
complete discussion of the Onsager reciprocity relations 
HS Given Nere. /Chapter Four rkdiscusses the nore recent 
Stability theory of thermodynamic systems and its 
relationship to fluctuations, following the methods of 
Glansdorff and Prigogine. Tne next two chapters provide 
explicit examples of systems which can exhibit 
instabilitives. “Chapter fiver deals with chemical ty 
reacting systems and the stability of steady states is 
THUtVOduced: ds 1s tne concept of man lint? cycle... “Chapter 
Six discusses the Bénard problem in which instability 
results from the heating of a layer of liquid. The 
resules Of apo lyiie the stabaliey criteria introduced in 


Chapter hour are compared) to tnesexact result. Finally, 
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in Chapter Seven, the problem of a turbulent fluid is 
discussed as an example of a system far from equilibrium. 
Part Two of the thesis discusses the microscopic 
foundations of macroscopic theories of irreversible 
processes. After some historical and introductory 
remarks in Chapter Eight, Chapter Nine presents some of 
the results and methods of classical non-equilibrium 
Statistical mechanics, including a derivation of Boltzmann's 
equation and a discussion of more general kinetic equations. 
Chapter Ten then goes on to study the fundamental problem 
OfetrreversibDihuty from both the classi¢al and the quantum 
mechanical points of view. A discussion of the various 
H-theorems is given in this chapter. The quantum 
mechanical linear response theory is presented and analysed 
in Chapter Eleven, including derivations of Onsager 
relations and a fluctuation dissipation theorem. Finally, 
the last chapter deals briefly with the general theory of 
irreversible processes, as expounded by Prigogine and his 


co-workers in-the years since 1957. 
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PAR id 
CHAPTER I 
INTRODUCTION TO PART I 


According to Planck, physical processes may be 
divided into three groups. First, there are the reversible 
processes. These are the domain of equilibrium thermodyna- 
mics and, although they form a simple and valuable class of 
processes, few real processes are truly reversible. 

The second group he referred to as natural 
processes. These are the processes which tend toward 
equilibrium monotonically. Such processes are described by 
a H-theorem and include many non-equilibrium situations. 

The final group Planck called unnatural and it 
included all those non-equilibrium processes which evolve 
away from equilibrium. In Planck's time, this last group 
was not considered to be very important, since it was believed 
that a H-theorem of some sort governed most physical systems. 
However, it is true that some systems never reach equilibrium 
due to the presence of some external constraint such as a 
temperature gradient. Also, it has since been realized that 
there are physical systems which do not return to equilibrium, 
or, do soi in: fan. osicil latory, manner...» Examples: of, osct katory 


systems include spin echo experiments and some types of 
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chemical reactions. Other examples of unnatural processes 
are non-equilibrium phase transitions such as the transition 
from laminar to turbulent fluid flow, shock waves in 

fluids, and plastic flow. These unnatural processes usually 
involve non-linear effects. 

A more modern division of physical processes can 
be made using the knowledge gained from statistical physics. 
First, there are the quasi-equilibrium phenomena which 
include the above reversible processes, as well as small 
PRuectuations:’ 

Secondly, there are the near equilibrium phenomena 
which are described by linear laws. In the macroscopic 
domain, this includes all of linear thermodynamics of 
irreversible processes and in the microscopic domain, 
linear response theory. 

Thirdly, there are the complex and less well 
understood far from equilibrium processes. These include 
non-linear effects, instabilities, and the unnatural 
processes above. An important class of processes which may 
be in any of the above categories is the class of time 
independent, steady state situations, including many 
transport processes. 

Ph thes 1trstsporcioneor thts stnesns. "Che 
generalization of equilibrium thermodynamics to the second 


group of phenomena, the near equilibrium processes, will be 
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considered. In.order to get from equilibrium to non- 
equilibrium thermodynamics, first assume that the macro- 
scopic system can be divided into many small cells. These 
cells are to be macroscopically small compared to the range 
over which the system's properties vary, but microscopically 
large so that enough particles are in each cell for the 
statistical method to be applicable. 

Secondly, assume that the system is close enough 
to equilibrium that thé above cells are in “local equilibrium". 
Hiietiers, castes that 11S possible tO find such cells, large 
enough to be considered as thermodynamic systems, which are 
close enough to equilibrium that thermodynamic variables 
Such as pressure, density, temperature, and entropy can be 
defined as constants in each cell, varying from cell to cell. 

Thirdly, treat these local thermodynamic functions 
as field variables and make them continuous. That is, 

Pence Tat ero veulee oil, ty. acc: 

Finally, write balance equations for the thermody- 
hamilc fields, Giving a local descriptron of ‘the system. 

The assumption of local equilibrium essentially is 
that it is possible to define a local entropy density S which 
is the same function of the local thermodynamic densities as 
the equilibrium entropy density is of the equilibrium thermo- 
dynamic densities. This implies that the Gibbs-Duhem 
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This condition, including the implicit assumption that the 
thermodynamic functions can be defined locally, is a macro- 
scopic validity criterion for the extension from equilibrium 
to non-equilibrium thermodynamics. To explicitly calculate 
the conditions under which the assumption of local equilibrium 
is valid, the methods of non-equilibrium statistical mechanics 
are required, as well as a microscopic model. The assumption 
of local equilibrium also clearly limits one to consideration 
of systems which can be described by an equation of state 
wnmenris tnidépendentsof “the gradtentsmof ‘the tlocal vitelds. 
An analogy can be drawn to a dilute gas in an expanding 
Containenatcr. pPGlansdorfif and Prigoginet[]}} peiid)yes This: is 
a non-homogeneous and non-equilibrium situation. However, 
if the expansion is not too rapid and if the system is not 
too dilute, the equation of state pV = RT is valid locally. 
Similarly, for local equilibrium, the Gibbs-Duhem relation 
holds. 

Microscopically, local equilibrium can be under- 
stood through the Boltzmann approach, in which an arbitrary 
thermodynamic function $(t) is considered to be an average 


of a dynamic quantity over a long time. In equilibrium, 
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The usual thermodynamic functions are independent of t in 


equilibrium. For non-equilibrium processes, in order for 


or©(t) to be meaningful, o""(t) can be defined as a 
finite time average, 
Ci. 
oM’(t) = =f o(t')at! (1.3) 
t-T 


N€(t) to have the desired interpretation 


Pods ,cin Ordey Tor 
as a non-equilibrium thermodynamic function, instead of 
Gaking 1-2, as#in equilibrium, it 18 necessary that 


Ce ST That is, t must be effectively infinite 


T . 
rel Di.0.e 


compared to the microscopic relaxation time Tt but 


rel? 
infinitesimal compared to the time scale for macroscopic 


thermodynamic processes, T THUS hts, required that 


DOC 
» which implies that local equilibrium holds 


yn eee "proc 
only for systems where strong dissipative forces are acting 
to damp any fluctuations. For example, this might be the 
case in liquids or in moderately dense gases, but would not 
be true in very dilute gases where there are few collisions 
or in fermion systems at low temperature, where dissipative 
processes are ineffective. 

Prom a practacal,point Ot Viewoe SUCh danvapproach 
PSO teUSe hues ince, Ln,order to apply it. thevexact 
dynamical behavior of ¢(t) must be known. Therefore, as in 


equilibriummstaristical mechanics, it is necessary to pro- 


ceed through an ergodic hypothesis to ensembles and partition 
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functions. The assumption of local equilibrium then requires - 
that the non-equilibrium situation must be describable by a 
par titi Onsfunetion close to an equilibrium partition function. 

The question of the existence of some of the 
equilibrium functions such as entropy or temperature in 
Systems far from- equilibrium has been raised. Hofelich [2] 
has shown that it is possible to find a Liapounoff function 
which has the usual properties of entropy and which has 
these properties throughout the entire range where the 
kinetic equations of the system are valid. However, the 
usual properties of entropy are not enough to define such 
an entropy function uniquely and the usefulness of such a 
function is questionable. 

Alternatively, Meixner [3] has discussed the 
possibility of a non-equilibrium thermodynamics without a 
local entropy. His theory involves only the exact equili- 
brium thermodynamic functions and the boundary conditions 
on the surface of the system. His approach also assumes the 
existence of a non-equilibrium local temperature, but does 
not require an operational definition of such a temperature. 
Meixner finds a new, integral formulation of the usual 
Clausius inequality op fe +¥ + s 2 0, which does not require 
the *existence of a local entropy density s. He then finds 
that the usual entropy balance equation is an equation for 


the entropy density exactly in equilibrium, where the entropy 
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production depends upon the equilibrium properties, on the 
non-equilibrium temperature, and on the dynamic properties 
of the system. 

Meixner's theory and the usual local equilibrium 
theory have the common feature that, in order for these non- 
equilibrium thermodynamic theories to be logically consistent, 
they must invoke equilibrium thermodynamics. This feature 
is due to the fact that such a non-equilibrium thermodynamics 
is an attempt to generalize an equilibrium theory to non- 
equilibrium situations without invoking dynamics: In other 
macroscopic theories, first a dynamic theory is set up and 
then the equilibrium theory is derived as a limiting case. 

It is obvious that a general non-equilibrium description 
must involve the dynamics of the system and thus cannot be 
reached via equilibrium thermodynamics. 

However, there exists an essentially complete 
classical theory, based upon the local equilibrium assump- 
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CHAPTER. I 
BALANCE EQUATIONS OF IRREVERSIBLE THERMODYNAMICS 


§2.1 Balance Equations for Mechanical Quantities 

Consider a macroscopic system in a volume V, 
bounded by a closed surface © (cf.de Groot and Mazur[4]). In 
order to derive equations describing the time evolution of 
various extensive thermodynamic functions in V and fluxes 
through the surface © , it is useful to write any extensive 


ud Vo) as 


Arty ert olrst) fir, tedy (nn 
V 


where f(7r,t) is an intensive variable representing the 
density of F(t) per unit mass (specific variable) and 

o(r,t) is the mass density as a function of position and 
time. Since the quantity F(t) is not necessarily conserved, 


the most general equation for F(t) is of the form 


dE(t) - pre] + oF] ow 


where P[F] is a source term describing production of F in 
the volume V and o[F] is a flow term describing the ex- 
change of F between V and its surroundings through the 


surface = . These source and flow terms may be written as 
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GN ea) ees de (223) 
es 
where Of iS the source: or Sink density in Vand Tip bs? tne 
current flow through 2 
foe caste stni1s#as a local equation, the Euler 
coordinate system is used. The Euler coordinates are fixed 


in space as opposed to the Lagrange system which moves with 


dol iat), _. 2G, 
the material. Then, oi aie = 3% 2 SO 
dF(t d > > iad ite 
FAt) - © J o(#.t) #(#,t)dv = f 2. (of) dv 
V V 
Nigam - fae: at (2.4) 
V r 


Applying the divergence theorem to the continuous function 


ae : 

Jp gives 

Carnes (25) 
For mass transport, f = 1, and since mass is 


a > 
conserved. eo = OF The mass current iseow so, for a one- 


component system 


OO ay, (ov) = 0 : (275) 
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More generably /arh ithe rej vare Nedifferent sconponents, “yi cin 
the system with densities D> tnen they satisfy the 


following equation: 
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where: ewe Js 1s..the production of component y in the Sth 
chemical reaction; 


Js Ws the GBeaction.rate for reaction. 6: 


ey 1s praportionals to the stoichiometric coefficient 


with which component y appears in the chemical 


equation for reaction 6 


Defining the following quantities: 


0 = oe the total density 


1) theacenter of mass velocity 


] 
: 2 Diy: V, the hydrodynamic (barycentric, 
material, or substantial) derivative 
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For balance equations for variables other than 


mass, 
ne ee: 
= 9 a + OV ©. Vf = lot y) 
ee ae (2.10) 
$0 
0 ae ade t = Vv: ie - pfv) 
s — PE). | (naan) 


For momentum balance, the source terms are known 
from continuum mechanics. They arise from external poten- 
tials and from internal forces which appear as a pressure. 
Using the material derivative, since the equation of motion 


applies to a volume of material, not of space: 


= \e De ie eras (2a Ze) 


where is is “tne external’ Trorce acting on component 17 and P 
is’ the pressure tensor due to short range internal forces. 
Eqn. (2.12) can be written in the form of a balance equation 


as 


=f oa > N 
GLOWS VG) (Be tpn) Es Pv i (2.13) 


where vv is a tensor product (dyadic). 


The term V - P describes the transport of momentum 


out of a volume due to conduction processes (momentum trans- 
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port through internal forces) while the term ie (ovv) 


describes "convection" of momentum out of the volume due to 
Eoe mOLTON OT ther tiuid.- As tn-the equation or continuity, 
the right hand side is a source term. If there are no 


external forces ge = 0) then, from conservation of momentum, 


3 ( Vv) A a >> 

tee tayo (P + pv) = 0 (2.14) 
In the center of mass (Lagrange) frame, there is no convec- 
tion term present and the pressure term gives the total 
momentum flow. 


In general, 
pear poe (2.15) 


+ 
where P~ is the elastic part of the pressure tensor and 


> : 
includes a term pU (U is the unit tensor, A - 634) which 


Laaeh 
is simply the hydrostatic pressure and where pd 


Gissipauivercontcipution, related to Wiiscosi ty.) Shor Tilanids.. 
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where 5 ovev is a kinetic energy convection term and 
> 


> 
P.* vy is a kinetic energy conduction term. 


The sources of kinetic energy are the external 
N er 
forces -2 P. hy - V and the pressure tensor term P : Vv 
ie 
which represents the mechanical energy of compression. 


For potential energy balance, if the external 


forces are due to some external potential, then 


> 
Ss 5 W 2419 
Ee v (2419) 
oy 
where Ate = 0 for time-independent forces. 
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where: ow represents convection of potential energy; 
N 


Seo bet iy represents a sink due to conversion 
y=] ERY 


of potential energy to kinetic energy (an equal but 


posite term appears in the kinetic energy equation); 


diet : 
eee represents the potential energy of 


Op 
N 
i 

represents the conversion of 

tial energy to internal energy by diffusion; 

r 

: Ue v6 Js is a source due to change in 

tial energy due to chemical reactions. 

In most cases, the last term will be zero, since 
the property of the particles responsible for the potential 
interaction usually remains unchanged in a chemical reaction 
(evo eeenedss ineds Gravitational, DOtent ial): seine tng.s. caser. 

; : 1 2 
the equation for total mechanical energy density (pw + 7 PV ) 
becomes 


] 
d(pp + 5 PV 2A 
> adi tty 


1 i cet 


e> N >+di 
AT ey a ae (2.22) 
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The presence of two source terms indicates the 
fact that the internal energy must be included in order to 
5 : : = Se Te ie 
mwevenergy conservation. In this lequatton.P =< Vv Ws*a 
source term arising from the conversion of kinetic energy 
to internal energy through compression and Viscosity and 


N : 
ie) adi tt - F is a source due to conversion of internal 


e Y uy 
al | 
energy: to potential energy: through diffusion processes. 


The total energy e may be written as 
aa 2 
Bes ON te ou aed Ker e8) 


where the internal energy density u includes the energies 
of thermal agitation and of short range molecular interactions. 


Due to energy conservation, 


eee) + ¥ - J, = 0 (2 24)) 


iiss impli less thav wire source cerm fOr WU as 


N P 
Gee Sere VV oe aqitt Saye , (2253) 


In analogy to the current for mechanical energy, 
the current for total energy has a convective term oeV, the 
previously discussed mechanical and potential flux terms, 
ee Vv and 2 ve ae ay, and a new internal energy flux Sf 
This one which is commonly called the heat flux. 
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(2226) 
and the balance equation for internal energy is 
he rag 
ee ye) =<. ey ee ee 
ot q os Yi + | 
y=l 
C2527) 


This is simply the first law of thermodynamics. 


ht can be put mn more familiar form as 
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see ae i ea ee sdiff 
MEA UKy c tap tie eS SP ere i 
(25.23) 
where: v = #0! is the specific volume; 


pais: She sic Mar thydros'ta tic "pressure; 

— > ay ; 

IT S0P} épU Mitseethel pressure Stenson without tthe 
hydro Sit.at Wer pdr tb; 

q is the heat per unit mass, defined by 
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The final mechanical density which will be 
considered is angular momentum density. If the angular 
momentum density is at then this can also be expressed in 
terms of an angular momentum density tensor J with 


components 


J (2 22:9") 
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where Ney is the antisymmetric Levi-Civita tensor. 
The local form of the angular momentum conserva- 


tion equation is, assuming no external forces, 


C2303) 


The right hand side represents the flow of angular momentum 
due to the torque exerted on a mass element by the pressure 
censor,. 
° = ° 
The angular momentum density tensor J is now split 


into two parts 


G2aeie 


is the usual angular momentum 
density*idue to the circulation of the material. In classical 
hydrodynamics, the material has no micro-structure and L. is 
the total angular momentum. More generally, there is another 
contribution se which is the internal angular momentum of 
the material. It arises from the fact that the molecules 
making up the material can have angular momentum (spin) 
WithOUL having a Macroscopic Tluid Velocity. wa can be 


written as 


(ed y op 9 9 
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where O: Ts ethe antisymmetric rotation tensor corresponding 


to W the angular velocity,and where © is the average moment 


Of inertia Der unit mass. 
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Taking the equation of motion 
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(22733) 


and multiplying by Y and subtracting a transposed term gives 


DV, by CROLEY 
A OnRrah Sge sane manna ’ (2634) 
Therefore, 
DL 3 
aB f a & > 
Dt t ra or Oa ve Pave et i (Pg a ay) 
1 fa sf 
eg Ss 
Hence, from angular momentum conservation, 
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bed GC aie - 
where P is) thevanrtisynmetric part sot. er. 
ita S = 0, the constituent particles have no 
angular momentum and = = Cane as iS usually assumed in 
continuum mechanics. The antisymmetric part of the pressure 
tensor is due to the internal body torques which are propor- 
tional to volume. These can arise if the constituent 
molecules are not spherically symmetric. If tne molecules 
are spherical or if they can be regarded as structureless 
; F om e eo? 
(as in a dilute gas), then PB = Pay and Sag = constant. 
> 
This means that internal angular momentum S and external 
angular momentum are separately conserved. In viscous 


fluids, however, the two angular momenta would not be 
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expected to be independent. Instead, viscous effects would 
result in transfer between internal and external angular 
momentum. 
om) , 
To investigate the effect of Ps on the motion 
foimeone TlUid, tas assumed that. the pressure tensor jis. a 
generalization of the tensor for a Newtonian fluid. That 
is, the pressure tensor components are linear functions of 
the appropriate velocity gradients. For example, if the 
MusScOUS Dart of P is separated and elasticity is neglected, 
- ano 
P U 


gb 
= p + JI 


where T is the viscous pressure tensor, written as 
a re AR 55) Paltah) 
UT Sales Wt heen II : (CrABNSi hd) 


Then the assumption of linear constitutive equations is: 


oe Se tyo) (V+ ¥) 
Rp : : “shear Caeer 

(i.@., (elas 7” nghear (Fe i a geet Sage 
Tha) - i ae iy xy = 20) (2:,33)) 


(Vv x Vv is regarded as an antisymmetric tensor) 


where three phenomenological coefficients have been 


introduced: 


19 


vn) (2)! Who 
a=ne'’”) nail iad | 
VE ¥.6 | cee we 
; eee: re ae - Pry | 
age TS Ss + ence ® lanl en ee 


iwpw esasris evoasiy ,Hapeeny, diabwsqethn shoe 
*ellives Tanvstxne Loe lonwelint anos 19e er 


f “4 ~ 
Hotton. sf, 10 He io Jostts. and. aieerheavas at ¢ 


6) 34 nbiakead Ssperet Sit Ded baMiles s eT nthe 
fant. oDEOTt ne taos vie Beton Mayan Shy. te sorees ital 
THyetorIoauy Yoont! -s7H. er honor So cues see ag 4 | 

ON ti - Sf qmsxs vO) .2eneihete. Yi tyalow, omer aornds 


bevosioan eo ythiisesols ie beperehse 31.794. 


_ 
& | ‘ 
eo ustPrYW VY OeTss. SD ees s065s2 fv oer let 


(XE .S:) , NR eee Pent Se 


7 | ap ' i i eo & . ‘ 
52h 2209'S Sips aye Doan Teton Ah evan! (ho eohtqnpeed ial nT 
C an ya) 
a: | oe f : _ ; 
} 


A li 


| - is BY G4 einetoTtiaps 199.1907 Gime ae 


7 7 ra c ve 
7 Vy 7) 7 > 
“ _ 2 
vi a . ie 


Nvol? inet bulk yiscosd ty 
1. payne tne shearaviseos ity 


Nybe? the rotational viscosity. 


bois the substitution of -n.,(¥ x 
Tha) that differs from the usual assumption that 

Piet chowassumed that the viscosaey ‘coerticients 
are independent of position, then the modified Navier-Stokes 


equation is 


Dv = > o> ik >,> > 
Seppe eee Aehean (3 Neha Terai Vy v) 
+ 7 Wee Cog eney txty) / ea (2739) 


In ordersto seéithe physical significance of the 
new term ee v xee20 = VOX Vv), two special cases are 
considered. 

First, pure expansion (no shears or rotations 


of the fluid) is considered. Then, 
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Thus, volume viscosity appears in the equation of motion 


but shear viscosity does not. If the molecules have spin 
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ini ta aliyie the, rotational.-viscosity will transmit the angular 
>> > : 
momentum and cause V x v to become non-zero (i.e., cause the 
fluid motion to depart from pure expansion). 
Secondly, rigid body rotation, where YV=bxr 
(6 a constant vector), is. considered . Then (Wi) AS) = 0, 


Sie cC c 
Vite ive = 0, and the only non-zero term in the viscous pressure 


&> mas 
tensor is re) = - ire tal ¥ ee ae The equation of motion 
_ 
ROMS: LS 
= 
iPS yal 2g Gy dl > Sab has 
pa ie reed Ee (V x ¥ 2u) ) : G24 Va) 


Considering a case where the rotation of the fluid 
=> 
is constant (V x v = 2b where = = 0) then since $ = 0, 


> An 
oe apes = ee (2.42) 


If initially w = 0 (the molecules have no initial spin) then 


fie Vipieleyichana (2.43) 
08 


where t = Aare 
Trot 


Thuswearter a time: 0 >> a7 ; 20 is essentially equal 
to Vv x v and the rotational viscous effects become negligible 
and the internal and translational angular momenta are in 


equilibrium. 
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§2.2 Models of Real Materials 
iVanonyvedpplbcacrons, iit 1S possible tor consider 
eicner elastic or viscous effects separately. ‘For example, 
in hydrodynamics, it is assumed that the fluid has no 
elasticity. Also, in solid mechanics it is often assumed that 
there can be no flow or permanent deformation and hence the 
stress tensor is purely elastic. However, there are situa- 
tions where both viscous and elastic phenomena are important. 
Examples are plastic substances which flow under sustained 
stress yet which retain many of the elastic properties of 
other solids. There are also some liquids with appreciable 
elastic properties. For example, there are certain "gels" 
wirch combine fluidity (low shear viscosity)’ with elasticity 
in such a way that immersing a pendulum in the gel actually 
decreases its periodsot oscillation (cf. Frenkel [5]7p.218). 
In purely elastic deformations, the quantities of 
interest are the linear strain tensor 
du, (rst) OU (r,t) 


B 
aa 
B aCe 
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] 
©a8 > ( Jr 5 (2.44) 


where Ledeen) is the_ascomponenmt. or tne wecvor u connecting 
the equilibrium position ry of a material with its position 


,after deformation, and the stress tensor 


y=) > a9 
7 Pe reel (2.45) 
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Ingaslineary elasticity, theory. thesmaterial, obeys 


a generalized Hooke's Law: 


Sony Fenold Qn 


BoB Eeys 6 


where the C are elastic constants. 
aby 6 


In viscoelastic theory, the rate of strain tensor 
J€ V 
Ct 
hag = te = 5 (ptt 8) (2.46) 


ab e) a1, pt 


Q 
< 
Qo 


ey 
must also be considered. Separating A into an elastic part 
+> 5 > &> 
ate) and a viscous part oe gives A = Ave) +) 
The equation relating the viscous part of the rate 


. <> . 
of strain to thermstress, tensor of 1s 


oa pU + 2n ) 


shear vol 3 shear 


eo <—_ 
Tr(KOY)D (2.47) 
where Tr denotes trace. This is for a Newtonian fluid where 
Eheestress tensor 1s a linear function, Of the rate of strain 
tensor. This. can be writtemsas 
$5 Se <> 
ot pula T= 2h ey) 


vi shear 


ee 
Soyer Tot ean a (2.48) 
The apparently arbitrary regrouping of viscous 
terns? as**to' Separate Viscous effects ‘of changes ‘in Shape 


(first term) and changes in volume (second term). 
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If the fluid is isotropic, the equation for 


Mnhears vorsscosistyt b Tis 
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where, as before, the separation is into shape and volume 
dependent terms. Here, Gis the shear modulus and B_ is the 


bulk modulus. 


Taking the time derivative of the elastic equation 
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and using the definition yt 


2 (c+ p U) = 2[A eee 5 Tr(a'®) 0] 
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é tb 
+e (V- gle) yf (2.50) 
Also, since Teh) ay os au) may be taken as a definition 
of lhl and with v = ae + a, the viscosity and 


elasticity equations can be combined to yield 
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This, equation, Valid for an, isotropic, Newtonian 


viscoelastic fluid, also assumes an equal relaxation time 
approximation, A = eo eg which 1s justified in certain 
5) n G 
shear 
simple models (cf. Lodge [6] p. 110). 
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It should be emphasized that eqn (2.51) is valid 
only as one possible model and is not a general equation for 
any effect involving) viscous and elfastirc™pnoperties. The 
essential assumption (other than that of linear constitutive 
equations) was that the effects of viscous and elastic 
properties can be considered separately and that the net 
erect is ‘simplyvadditive. 4 This’ corresponds’ toc the 
“Maxwell model" for viscoelastic solids. This model is most 
Simply illustrated by the one-dimensional apparatus in 
Fig. 2.1. The spring (elastic effect) and the dashpot 


(viscous effect) are assumed linear as 


GG. = Geeetor the spring alone 


and Oo =n ae for the dashpot alone, 


where e€ is the displacement. The equation of motion for 


the system is 


= oho = 38 (2.52) 
in obvious analogy to the tensor equation for an isotropic 
VRSCOR Test To urluid cean.. (2.51) oe | 

| However, it’'is obvious ‘that there’ are’ other 
Viscoelastic models possible and; ino fact,” the Maxwell 
Models 1s Inadequate to explain Viscoelastic etfects” in real 
solids. For example, another model is the Kelvin model, 


iieustrated Inlhilg. 2.2. bhe-equation of motion for this 
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One-dimensional Maxwell model for viscoelasticity 
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dimensional Kelvin model for viscoelasticity 
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spring constant 
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model is, in one dimension, 


o = Ge +n oe : (2556S) 


§2.3 Entropy Balance and the Second Law of Thermodynamics 

After considering the balance equations for the 
various mechanical quantities, the connection to thermody- 
namics is made by writing an equation for entropy balance. 
For a macroscopic thermodynamic system, the entropy S which 
has the following properties, is introduced. 

Firstly, it is additive (the entropy of the sum of 
two systems is the sum of their entropies). This implies 


that a differential change in entropy dS can be written as 


Sane dS, cs ds. : C2i5 #) 


Here, ds, arises from the exchange of entropy with the 
System's surroundings and ds; somes from internal production 
Or destruction of entropy. 

Secondly, ds, can be positive, negative, or zero 
depending upon the system's interaction with its surroundings, 
but ds, 2 OF always. YAISO, ds. = 0 only for reversible changes. 
ihus.wtom anaasolated system, ds, = 0 since there is no 
interaction with the surroundings, and hence dS 2 0 (second 
law of thermodynamics). 

Finaiiy, if the system is tree to receive heat from 


a reservoir at temperature T, but is otherwise isolated 
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(closed system), then dS, = ea ~ VHences dSe- a which 


is an alternate form of the second law. 

Under the assumption of local equilibrium, it 
is possible to introduce a local entropy density s, an 
internal entropy source density Oo: and an entropy flow 
density 2 which includes both internal and external entropy 


flows. Then, 


aoe = fad. (2055) 


Since, tn Vocal equilibriumesi tuations s. = s(usv.c ) 


is a continuous function of the internal energy density u, 


the specific volume v = in and the mass fraction 


Y = p/P » Gauss' theorem can be applied to yield 
ds ds. 
dS 2100 5) eae Sen: 
diby Lirgee oo! ote qeocal Ge 
V 
> oi 
et-iif (Ve. sheath all hig dV 3 2.90) 


Hs et NIe|n 
wot t VG es Oe: ’ 


gedtode Tan s2» 


(ee /S) 


aie Vt) eS gn) skis 1 


i Ye ran ob Yor 30 3 ht 


wil Datag2 ons ibe mtorr mes 


oO Ve PeNSH HS 1db2 YQOTIRES 


vind Thins Teodl ot bonre 

) Se | 
Wait iid, Oe ha?” Pare 
) AOTIOR ee 


mety Oy bai 


We gob neie ineneg 


‘0 ee uly ait Vepae 


evo!) # e5yhovtnt oe wat 20. 
‘ er ec 


Ar algoe eabulant: wore it 


' q 


eee Te 


at 
eT 
- 
if 


bis iu" —™% sangihey »inioane 


faqhe sd hea mevosht "aeuea aha - 


Hence, in local form, 


alps) + vi] . ay = O. C2657) 
where Oe O°. sAlternatively ; 
Ds = aS 
Pe Ye Ce - psv)_= O. , (pono 6) 


To find explicit forms of ie and o,, the Gibbs- 
Duhem formula must be used. Using 
aS oS N os 
ds(u,v,c_ ) Sa du + = dv + hs ae (2.59) 
2 nes x 
and the definitions 
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where p is the equilibrium pressure and Hy is the chemical 
potential per unit mass for component y, the Gibbs-Duhem 


relation is found as 


N 
Tds = du + pdv - = u dc, : C2260) 


This, DY Virtue of the local sequninDr1umscondi1t10n. 
TS Valid’ near complete equilibrium: ln particular, .looking 


at a volume element in the center of mass frame gives 
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where A, = ZX wv uw. is the chemical affinity. The terms 
6 eq Oman, 
in this equation can also be rearranged into a balance 
equation: 
SEG a 6, (2868) 
, 4 3 N pte 
where SED eva ee Oe eT } (2564) 
S 1 y=] Y Tt 
and 
ee Nicwely eee fe NY adiff | a, 
J, = ae We Mei he 4 We) 
q y=1 -% fe a. 
1 or Shepioal pplegt yg (2.65) 
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The separation into sources and currents is 
determined by the conditions that om must be zero if the 
system is in equilibrium and also that the separation must 
be invariant under a Galilei transformation, since the 
concept ot arreversitbi lity ts independent of tyamervor 


reference. Note also that, since for a closed system 
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Wes tructurewot the entropy source term: is. that 


of a sum of products of thermodynamic fluxes and generalized 


thermodynamic forces. The various terms are: 


oe ° V(t), av heat conduction term. (The flux 


is the heat current ia and the force is ¥ (4) 


related to the temperature gradient. ) 
N 


uF yy adi ff ns , a term describing diffusion 
hears, Sey i 

feat .. «diff 

in, anuexternal fields 2(ihe flux ts J and 


the force is i F , the external force.) 


ie ey 
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> Jy : Tao adit tus 10M, term due sto 
ve, 
chemical potentials. (The flux is again 


u 
ae but the force is - V(=“), related to 
y iD 


the inhomogeneity of the chemical potential.) 


ae ree Vv, a viscous pressure term. (The flux 


is fib related to momentum flow, and the force 


is - ; WW, the velocity gradient.) 
re 
ats Bie ape , a chemical reaction term. (The 
tf re On BO 
xe Ts Js the reaction rate, and the force 


which drives the reaction is the affinity As.) 
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Note that it is possible to put some of these 
terms in a different form. For example, by redefining the 
heat flow an to include heat transfer due to diffusion, the 
term involving VT and ‘isu can be eliminated. 


In general, the entropy source Oo, may be written as 
Cit) are eV as ake C2260) 
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where the Y are tne thermodynamic fluxes Cis che T 


etc.) which are "driven" by the conjugate thermodynamic 
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The next’ chapter will include a study of the 


Structure of tive entropy source term. 
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CHARTERADIL 
LINEAR PHENOMENOLOGICAL LAWS 


Borin? Cheosang. Forcesfiaand “Fluxes! 
From the balance equation for entropy, it is 
known that the entropy production Ce Lean be written as a sum 


of products of generalized thermodynamic fluxes G and forces 


X.. For the conditions considered in Chapter II, 
cece pada alba pr oa lie MIA ne Dk RE 
S q 12 ij eas y y = Y T 
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- = I ViVi eee, Mae. A 
i J Bar| 6 6 
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= gt YS Keys ; (36a) 


Intuptively., for jeach termein eqn. (321), 1t: 1s 


possible to separate the force and the flux. For example, 
for thermal conduction, X.Y, = - 5 


multiple of i is interpreted as the flux Y,, while a multi- 


(4, VT) and some 
t 


pie 30 f Wale regarded as the force Xi. The choice of 


proportionality constants must -be madesinesuch.d way sthat 


XY, = - ty ty <a bet Or example, one choice would be 
T 
X, = = VI and Yy = Is Ue and an alternative valid choice 
u, 
would be x, = ¥(z) and Y; = ak Such choices are essentially 


ones of convenience and have no effect on the physical 


interpretation. 
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The intuitive separation of forces and fluxes 
seems to be based upon the concepts of cause and effect. 
In a given experimental situation, it seems possible to 
establish, as a constraint, one of the components of each 
term in O.- For example, temperature gradients are esta- 
blished by putting different boundaries of the system in con- 
tact with reservoirs at different temperatures, external 
fields are applied, gradients in chemical potentials are 
maintained by concentration differences, shear flow (gra- 
dients in v) is maintained by suitable boundary conditions, 
Or non-zero affinities are created in chemical systems by 
adding reactants. ‘These externally applied forces are then 
seen as "causing" the corresponding fluxes. However, the 


clear-cut distinction between controlled external forces, 


Such as VT, and-tne resuruing Fluxes. ssttcn as ace disappears 


when it is realized that VT itself is not controlled, but 
rather boundary conditions are established. For example, 
consider conduction of heat in a slab with its ends main- 
tained at different temperatures. In order to find T(r,t), 
and hence to find VT. it is necessary to solve a boundary 
value problem involving the specific heat of the material 
and the heat current ap as well as the boundary conditions. 
Hence, the “applied force" VT implicitly involves the 
‘resultant of bux. Je a highly unsatisfactory state of 
atfaivre..) sit ts obvious !y desirable to have a mucn more 


specific criterion for separating forces from fluxes in 
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thermodynamics if these concepts are to have any real 
meaning. 

The main reason for wanting a clear definition of 
force and flux is to judge the validity of certain symmetry 
relations in the phenomenological laws connecting the 
forces to the fluxes (Onsager reciprocal relations). 

First, the form of these phenomenological laws 
will be stated. In equilibrium, the applied forces are 
zero and, in agreement with the usual concept of equilibrium, 
it is desirable that the resultant fluxes should also be 
2e0 a4 bRoitiarsicassumedithat <each flux le can depend upon 


all of the forces Xa then 


Y; = ¥.(X), -»X,) (ecmece) 
if there are n separate forces. 
In equilibrium, 
Vee(05 08 26 280) =O : (Sri) 


Hence, for sufficiently small deviations from 
equilibrium, the form of the phenomenological relationship 


between forces and fluxes is 


n 
F fis ence aaah (3.4) 


where the Lay are constant phenomenological coefficients. 
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This general form includes the usual phenomenolo- 
Gucal linear equations Of .Macroscopic physics as special 
cases. For example, Ohm's law (J = of where o is electrical 
Pongductivity). Eourier's, law ar = iene 1s 
eherinal COMGUCTIVILY),, Fick's law Of-diftfusion (Gy T=- din, 
where n. is concentration of "y"), and Newton's law of 
Y ON aN 


fraction (F 2 ey erg oe 
B a 


all special cases in which only one flux and one force are 


) where o is stress tensor) are 


present. More generally, processes involving several forces 
at once may be considered. Thermoelectric, electrokinetic, 
and galvanomagnetic phenomena are examples of such complex 
processes, as well.as thermal or electric conduction in 
cases where the current is in a different direction from the 
applied force. 


The above examples generalize, for vector phenomena, 


to 
Woes ob 
iC any 
Jq (VT) 
0 tak D(Vn_) 
&—_> 
Ais0_ NaBy 6s avy OV, 
oe 5 (org or) (350) 


where the constant coefficients have become constant tensors. 
For other examples, see the article by Miller [7]. 
The positive definite property of the entropy 


production results in a condition upon the coefficients Lips 
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In order for this bilinear form to be positive 
semi-definite, all the diagonal elements Lig must be positive 
Or zero. The restrictions on the off diagonal elements are 
less severe and are of the form Lis Leg 2 x (Li, + Beals 
Hence, the off-diagonal elements L5, (i#k) are not necessarily 
positive or zero. For a derivation of these conditions see, 
for example, Hoffman and Kunze [8]. 

Note that it is only the symmetric part of the 
matrix L which contributes to the entropy production. That 
yey nd CY ee ea fy (s) 


where L is the symmetric part of 


zie oad Oe the antisymmetric part, then 
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and there is freedom to add an antisymmetric part to ‘L with- 
out changing via This is important when considering the 
dependence of the Onsager relations upon the particular 
Cnorce of forces and Ttiuxes” 

Kiso in’ most systems, the” components of the various 
flexes do not depend on all~or* tne forces. ™inise FS. -d 
Consequence Of What 1s catled Curie s™principTe.*» Foosety 
Stated. Gurne*s Drinciple assercs that, ia) an “isotropic 
medium, fluxes and forces of different tensorial character 


do not couple. Some care must be taken in interpreting this 
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principle (cf. Truesdell [9] pp. 134-137; de Groot and Mazur 
[4] Chapter VI) since it is not immediately obvious what is 
meant by tensorial character. For example, a second rank 
tensor may be regarded as being composed of a scalar (the 
trace of the tensor), a vector (the antisymmetric part of 
the tensor, an axial vector), and a symmetric tensor. 
however, with proper care, this symmetry of an isotropic 
System can be used to reduce the number of independent 
relationships between the forces and fluxes. For example, 
in an 1sotropic fluid, heat conduction and diffusion are 
vector phenomena, and viscous phenomena or chemical reac- 
tions are tensor and scalar phenomena respectively. 

Incsvsitens wnichvabe. NOt SomRyopIC.. it 1s also 
possible to use the symmetries of the system to reduce the 
number of phenomenological coefficients. For example, in 
crystals it can be shown that , the heat conduction tensor, 
is symmetric in nineteen out of the thirty-two possible 
point symmetries and in the others, itis of a simple form, 
bye Using the crystalline symmetries only (cf. Miiler fia). 

As a consequence of the fact that different 
tensorial phenomena do not couple, it is found that the 
entropy production separates into several terms (for iso- 
tropic media), each of which is separately positive semi- 
definite. 
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In addition to these restrictions which are due to 
the spatial symmetries of the system, there is another 
class of symmetry relations between the coefficients Line 


referred to as Onsager reciprocal relations. 


§3.2 The Onsager Reciprocal Relations 


The Onsager reciprocal relations may be stated as 
(S503) 


This means, for example, that the heat conductivity 
FensOrsis;ssymmetric. for ald materials. note just. forsspecial 
Crystal line symmetries... For ,other,expliciteexamples. i see 
Ma eke We Ly) 

A derivation of this theorem, along with a discus- 
sion of the assumptions implicit in the derivation, will 
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er rdeyce for the Onsager relations will be "aivens. “For now, 
it will merely be noted that the Onsager relations are 
generally considered, to result from microscopic reversibility 
of the equations of motion. Some modification of the form 
of the Onsager relations is necessary in the case where the 
equations of motion are not simply time reversal invariant 
mitseOCCUrS, fOr exanple;, 1f “magnetic fields or coriolis 
forces are present, since these change sign under time 
reversal. 

| Before giving a derivation of the Onsager relations, 
Some discussion Of theseffects of different ‘choices of forces 
and fluxes upon the Onsager relations will be presented. 

In the dertwation-of the Onsager relations, “it 1s 
assumed that both the forces x. and the fluxes Y. separately 
form linearly independent sets. In choosing appropriate 
forces and fluxes, linear dependence might occur in two ways. 
First, imtuition might. be So faulty that what iwas  belweved to 
be an independent force or flux was merely a linear combina- 
tion of several other forces or fluxes already considered. 
More likely, however, is that some constraint upon the system 
would be neglected. For example, if, in multicomponent 
gp tusvon. cae Vallous. Mass currents Wy are defined with 
respect to the center of mass, there would be a constraint 
that : j ="0, which would result in dependent fluxes. 


ya 
Similarly, the forces could be made dependent by a constraint 
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that the system be in mechanical equilibrium (cf. Hooyman 


endadesGroot e[10).)r1uLi, for examplessacconstraint 
n 

‘2 

Xs are independent, then the entropy production may be 


written as 


n - P 
ig LR ERS Cae ie Pe Oe ean! (3-211) 


With the new set of (n-1) independent forces and 


fluxes and with phenomenological equations of the form 
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ae Ss ee (X, =X) : (3212) 
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thats is even for’ the non-ianacependent set 
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Similarly, if the forces are related by a con- 
straint while the fluxes are independent, the Onsager 
relations remain valid. 

However, in the general case where both the 
forces and the fluxes are dependent, no Onsager relation 
holds. Under such-eonditions, there is a certain arbitrariness 
in the choice of phenomenological coefficients in the de- 
pendent sets. The coefficients Li; can be chosen such that 
Lay = Liq 
Onsager theorem is destroyed and, to ensure the Onsager 


but need not be. Hence, the validity of the 


theorem's validity, a complete and independent set of fluxes 
or forces must be chosen. 

It can also be shown that, once the fluxes and 
forces are chosen and Onsager relations established for them, 
these relations remain valid even if a linear transformation 
of the bases is made. These transformations are restricted 
by the condition that, if the forces are transformed, the 
value of om must be preserved. This invariance of oF, is 
also the condition which ensures that Li; and Lj have the 
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and [L5,] = Bo/o, 4 (Goal 7p) 
. if entropy 

However, LY, JX, ] LY, J[X,] TO hinea anne C3 as) 

SO By | = Bo o 

Or By/d5 = Bo/a, d (3.19) 


Thus Lio and Loy have the same dimensions. 
To see the transformation properties of Onsager 
relations, consider the non-singular linear transformation 


Of the forces 


Mao ; Ajj x, ; oer 


Assume also that the fluxes obey linear phenomeno- 
logical equations 


Vi te Ree (53 ri8) 
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hie orrcen aoY Ore to be invariant, the fluxes must 
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Ge. » x. Y; = 2 x Y; (32s) 
1 1 
or As kre x Ai il ere 
i,j dade Wale es i.i.k.m 10 eee oni je 
(3424) 


The most general solution of eqn. (3.24) is 


ni AG Bik Lin : Lim ‘ Dim (3.25) 
where Din Sova anDlcrary ant_Symmetr ie matrix le = - Drgee 
Then the phenomenological equations become 

Y; ee ae X; (63772 6h) 
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Davies [11] argues that transformations involving Li; are 
unphysical. However, he gives no explanation of his claim 
and later de Groot, Hooyman, and Mazur [12] and also 
Truesdell [9] argue that exclusion of such transformations 
cannot pe justi+1ed on this basis. A transtormation of the 
forces which involves Lj implicitly involves the fluxes. 
Truesdell [9] gives an example where the original sets are 
jo Xpe sees X)s (Yo; Vos bee we) and the transformed 


sets are (Y,, Xo » ae Xx) and (X,> Yo» epee eae Under such 


(X X 
transformations (equivalent to transformations of the forces 
involving Lig)s the Onsager relations do not remain valid 

in general. This makes it even more desirable to have an 
Sxpiicitarune. for separating forces and fluxes. 

In Casimir's [13] derivation of the Onsager 
relations, it is assumed that the deviation of entropy from 
its equilibrium value is a negative semi-definite quadratic 
functional of the deviations from their equilibrium values 
of the thermodynamic variables. That is, if the thermody- 
namic variables are x ee xt 4 a) and 1f AS = 5 - 5, where 


0 
xt and a are the equilibrium values of ieand Samer 
ee us ce | Se ec ak (ese ola) 
anpegett & 


where S. is a positive semi-definite form. 
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Then, it is assumed that the fluxes are the time 


; : 1 ee : : ' 
Seriwativestoptthe aussaneihisawould'seem to giveas criterion 


morachoosingdthegforces and fluxes, butudruesdel} [9]-argques 
firstly that merely being the time derivative of "something" 
is meaningless so a prescription for choosing the appropriate 
variables a iSySti needed. He  alsomraises a secondsobjec- 
tion, namely that in the cases where Onsager relations are 
Csualtyrapplied, ttedis*not.at.all.obVious thatthe fluxes 
under consideration are the time derivatives of any signifi- 
Ganingtantitye adm Gasimir’ sofirst. examples ot) di fiusionsof 
gas through a hole in a partition separating gases at two 
different temperatures, the numbers ny and No of molecules 

in each compartment are obvious choices of variables and, 
using ane eee internal energy, and its time derivative, it 
is possible to correctly derive Onsager relations between 

the concentration difference caused by the differing | 
temperatures and the energy carried by the molecules. 
However, in the more general cases to which Onsager relations 
are often applied, for instance in deriving the symmetry 

of thetheat,conduction* tensor, 1t. 1S»necessary, towuse,more 
complicated and less convincing arguments to show that the 
derivation of the Onsager relations is still applicable 

hee Truesdell [9] or Casimir [13]). Truesdell argues that 
ineother. thermodynamic processes, #there,is even less» justi- 


fication for assuming the Onsager relations to be valid. 
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It has been shown that the invariance of Oo. alone 
is insufficient to guarantee the validity of the Onsager 
relations under general linear transformations of forces and 
Fluxes. Hooyman, de Groot and Mazur [12] propose that a 
more restrictive condition be applied. If it is assumed 
that the entropy with respect to equilibrium, rather than the 
entropy production Oo. is required to be invariant under the 
transformations, then the symmetry of Lay is preserved. 
However, this criterion suffers from the drawback that it 
has never been applied to show the validity of the Onsager 
relations in common thermodynamic situations. This is 
probably due to the fact that AS is expressed as a quadratic 
functional of the onpis rather than directly in terms of the 
wsiar! efioyice’s, aind,s fluxes. making ‘apple Gati-on diffi-cu let: 

As far as the experimental evidence is concerned, 
there exists a comprehensive review article by Miller [7]. 
His uncritical conclusion is that, for all the phenomena he 
considers, what evidence there is agrees with the Onsager 
reciprocal relations. Truesdell's [9] more critical analysis 
ise that there is 1nSuthicient data inmsevenatscases sano lably 
with respect to symmetry of the heat conduction tensor, and 
Enatesineornwern cases, particularly for tothermal tennary 
diffusion, the limited data seems to contradict Onsager's 


theorem. However, due to the difficulty of the experiments 


and to the fact that they have not been repeated, it is 
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possible that the apparent disagreements would be removed 

by more accurate experiments. It would seem that there is 

no definite counterexample to the Onsager relations and 

that, for many phenomena, there is good experimental evidence 
for their validity. However, in many cases, the symmetry of 


if can be derived independently from Onsager's theorem and 


VJ 
hence these cases do not serve to confirm the Onsager 
theorem in all its generality. 

In order to derive the Onsager relations, it is 
isefuloto first consider’a transparent case, that of a 
simple chemical reaction triangle (due to Onsager [14]). 
That is, there are three chemical reactants A, B, and C with 
Nays Np» and n, molecules respectively; if ne Nps and ne are 
their equilibrium numbers, and if the rate at which species 
A spontaneously transforms into species B is KA (a constant), 


the equations for the numbers of molecules of the various 


Species are 


my 
ag, = z-‘Kpast Scalta * Kapp # “ache 
dn, 
AE UEGKEAULGR GGABe F OCR? BER ERBEGRE 
dn. ; 
Aggie Che Adnes CREB (Kac + Kg) Mc (3.32) 
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IV tei aa ny Urea ban 2 ( (3n033 } 
and 
dn, | i dn. ; dno ms (3.34) 
dt FF dt ns dt . : 
A B C 


If the equilibrium concentrations are known, then 
there are two independent constraints On the six coefficients 
Kap> Sace cc+e Kop - Thus, even if the System is assumed to 
be in equilibrium, there are still four degrees of freedom 
in choosing the rate coefficients. 

However, the usual procedure in chemistry is to 
assume detailed balance. That is, it is assumed that, in 
equilibrium, each simple reaction exactly balances itself 
nee, Kean = Kapnp » etc.) Malt is possiple to imagine 
equilibrium situations not obeying detailed balance (e.g., 
ee eh 7 ce Be on > Kap 7 ep) a eS uCh sa sreact Tonk 
while it satisfies the equilibrium requirement, is ruled 
out by considering time reversal. In the simplest pnysical 
situations (zero magnetic field, etc.), the underlying 
microscopic laws of motion are time reversal invariant. 
Thus ,?for"any microstate there is a corresponding state with 
all velocities reversed. Since in equilibrium all allowable 
Sibates have equal a.priori probabilities, seach time reversed 
motion occurs, on the average, as often as the original 


motion. As a consequence, in equilibrium, each direct reac- 
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eion A > B must occur as often as the reverse reaction 

B > A. This means that detailed balance holds as a conse- 
quence of the time reversal invariance of the microscopic 
motions. The consequences of such time reversal invariance 
were pointed out much earlier by Nernst (1883) and Bohr 
oil 3). 

The analogy between linear rate equations in chemi- 
cal reactions and the general phenomenological equations 
discussed earlier can be made closer by rewriting the rate 
equations in terms of forces and fluxes. 

FOnvan wdeal Solution at constant pressure and 
temperature, the free energy G can be written as 


n n 


oA B é 
G = Conia Rey {ny In aa + np In = + one In fey 
A B C 
(oo 08 
where Goquil is the equilibrium (minimum) value of G. Then, 


fo ofiursit order in bnas 6Np » Sine (small changes in Nas Nps 
Ne) 
n n n 
86 | = RT (én, In(=") + Sng In(—) + Sn In(—)}. 
Ae "A "B He 


Defining a, = ny - ae etc. gives the fluxes as a, = ny 


(the dot denotes time derivative), and also 
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ine forces” X no Xp» and Xo are now seen to be 


n 
Ky = - RT In(—") y - Shay, ete. (3.38) 
A A 
for small Ans Ans Ae 
The rate equations can be written in terms of the 


forces Xqs Xp and Xo and the fluxes On» Ops and Ot ¢ as 


n K n K n 

adele A AB "Bp Ac "c 
On = (Kea + Ken) RT Xq - RT Xp RT *c 

K n n. K n 
: BA A B Bc "¢ 
c oih GERIWANGORSL ODS GRLAeEE Che meRiod os 

K n K n n 
cA "A cB "Bp C 
cA eS TEGE A oC RIE? Ob. SeeenGes Gpov sete <c 

(3.39) 


has 1s the. Form Sul table = ToOrmtne application. of 
Onsager's theorem and it is seen to be valid, due to 
micro-reversibility. 

The next step is to generalize the-above consid- 
erations in order to derive Onsager relations for any thermo- 
dynamic forces and fluxes in the near equilibrium (linear) 
range. In the example of a chemical triangle reaction, the 
Redctions =A > B. Bb > ©, etc. were considered. These reac- 
tions might be thought of as progressing with non-zero rates 


Keane Kepe etc., even in equilibrium. Although in equilibrium 
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eye rates balance in such a way that the net rates are -zero, 
at a microscopic level the separate forward and reverse 
reaction rates retain a clear intuitive meaning. It was 
considerations of micro-reversibility which made it possible 
to derive Onsager relations for the observed rates near 
equilibrium. In order to generalize this derivation, an 
analogous quantity to the rates is needed. This quantity 
must be time reversal invariant on the average. The most 
obvious choice which is common to all thermodynamic systems 
is to consider fluctuations of thermodynamic variables near 
to equilibrium. 


In deriving Onsager's theorem, the method due to 


Casimir £13] will be followed. Due to the assumption of local 


equilibrium, the entropy S may be expanded as a Taylor series 


about its equilibrium value. Writing a = (eh WUC ARE 08) 


to denote the deviations of the extensive thermodynamic 


variables A. from their equilibrium values Le Gitex. 


a, = A. - ACT), gives a = 0 in equilibrium and 
n n 2 
aS ] BES 
Sa) = Ss(ovien ahi a. t > 
Ve gi al rd Ae apt) Is Sea 
014 Os + (3.40) 


Since S is a maximum in equilibrium, 
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Since entropy is an extensive variable, as are the 
n 
eS 5, ks Sas Os is an intensive variable. 
=] 
The conjugate driving forces x may be defined, in 


the spirit of equilibrium thermodynamics, as 


Pes : 
1 = 


As local equilibrium has been assumed, it is also 
assumed that expectation values of the near equilibrium 
variables may be defined as averages over an ensemble. For 
this, the Einstein formula for the probability density W(a) 


Ms used: 


Wiajde = “oe (3.45) 


With this expression fOr tne=propapllyeyedens ity, 
several averages can be computed (cf. de Groot and Mazur [4] 


pps 67-69). Assuming the a, are independent, 


Then, since 
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n 
: = 
Os —- ee ae X; 3 (3746) 
j=l 
J -] 


For simplicity, only variables which are even 
under time reversat~will. be considered-initially (e.g., 
kinetic energies). Such variables as angular velocities 
and such phenomena as magnetic fields which change sign 
under time reversal will be excluded for now. 

Since for every microscopic motion there is an 
equally probable motion with all velocities reversed, time 
reversal invariance holds in the sense that the average of 
a variable om must be the same for equal positive and 
Bedative times from.some initial instant... That 7s, 


a(t) 
AV 


Ry 
ctr 
~~ 

| 


<a. (t tT) = <a, (t - t)> (3.48) 


AV 


where the a(t) superscript denotes the fact that the average 


is now over all states which have the initial condition 
Q = a(t) Qtatity PE thissisenow multi pbhitedaby a(t) and 
averaged over all possible initial conditions a(t), the 


result being denoted by <a s(t) a(t ie) et hen 


<a ;(t) a(t + t)> = <a .(t) a(t - t)> ; (3.49) 


This is a statement of the assumption of microscopic rever- 


sibility, valid near equilibrium. 
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If the system were exactly in equilibrium, the 


result would be independent of t and it may be assumed that 


<a, (t) a(t oak eae <a s(t ne ih) a. (t)> (3e50)) 


provided that «a ‘<< t-Y where 1° 


1S) ay Mecroscopic evolution 
time for the system as a whole. 

If the thermodynamic fluxes in the phenomenological 
equations are considered to be Os the time derivatives of 
some thermodynamic variables, then the consequences of time 
reversal invariance upon the phenomenological coefficients 
may be seen. In order to derive Onsager relations, some 
assumption must be made about regression of fluctuations 
(i.e., about the form of the equations of motion for a. ). 


The macroscopic linear equations.are of the forma. = = L.-:X 


i naan ee 
J 
The usual procedure (cf. Onsager [14]) is to apply this same 


Eis 


Macroscopic equation to the microscopic: fluctuations a. 
Although the linearity of this equation may make this 
procedure seem plausible, it is possible to imagine a 
psuedo-linearity which holds only at moderately large values 
of a. Also, as will be seen, there is some difficulty in 
defining the time derivative of a 

In order to extend the linear laws to the range of 
fluctuations, a Langevin equation could be substituted for 


the simple linear equation. That is, consider the equation 
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where Pi = a a Si and <k.(t)> = 0 for time 
averaging over times much greater than Ty> the microscopic 


relaxation time for the system. This is simply adding a 
mauctuating, force Kk to the linear force. This equation may 


be solved for a(t) as 


“> 
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a(t) =e” alo) te 
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nus, Ne 
a(t is — 
<a(t + t) - a(t)> = 6. teu nee Coen 03853) 
AV 
The macroscopic linear equations would only be 
expected to hold at. a microscopic level for 7 >> T, «Then, 
weetP <<.) (i.e., 1 << t"), it is valid to write 
> <a ae 
cake le Maye Pout) so tity, Spe EPG Oo WeateRed (ts 
AV 
= T F Li ee b3r54) 


Therefore, 


<a, (t) La, (t + Tt) - a (t) ]> = 7 : Le <a 9 X5> 


a Keele : (355 5)) 


Similarly, 
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However, microscopic reversibility implies that 


<ap(t)[a,(t + t) - o,(t)]> 
gps Lot 1) ta aia 


= <a (t + t) Lo, (t) = (oe(tatea) > 


 ( 


cope) tc) Ot Mt ca) a 


(3.56) 


This completes the derivation of the Onsager reciprocal 


relations 
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However, there are several steps in the derivation 


which qualify only as hypotheses. Some of these are: 


(1) 


(2) 


near™equilibrium, AS 1S “a™quadratic function 
of the a. 1S 5 

entropy 1s proportional to the log of the 
volume in T-space near equilibrium (These 
first two are essentially the assumption of 
local equilibrium. js 

in the fluctuation range, the forces and 
fluxes obey a linear law (or a Langevin 
equation) and, more importantly, that the 
coefficients in this linear law are identical 
to “the icoefficlents. in -themmacroscopre 


phenomenological law; 
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(4) the system has a relaxation time Ty in which 
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where T is the macroscopic evolution time of 
the system; and 

(5) the forces and fluxes considered in a real 
system are actually of the form assumed in the 


derivation, or can be reduced to such a form. 


The assumption that the variables a, are even under 
time reversal is not essential and the result can be 
generalized. If B are variables which change sign under 


time reversal (e.g., angular momentum) then 
er) Sh ea) aise cae dul Ts oe) 
and <as(t)B (t + Bee hy 9 CC a) 
(320) 


Entropy, being an even function, can be written 
n m 
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and the phenomenological equations can be written as 
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Also,if magnetic fields are present, the motions 
are the same if all the particle motions and the magnetic 


fields are simultaneously reversed. Hence, 


,g0B) = byy(-B) 
by 8) : Ee ie?) 
Pee) = - L,;(-B) 63-53) 


is the general form of the Onsager relations where B repre- 
Sents magnetic fields (or any other forces odd under time 
reversal). 

Thusmnit is seen that, while the Onsager welations 
do have a basis in microscopic theory, they are far from 
Peimderidoroushy proven=in all) theirnggenerality. “It seems 
the assumptions necessary to derive the Onsager relations 


place restrictions on the type of system to which they are 
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applicable. Casimir [13] argues, and it appears reasonable, 
that the Onsager relations should apply to systems which can 
be treated by the Boltzmann equation. 

For clarity, a straight-forward example of Onsager 
relations is presented. Consider a container separated into 
two equal compartments by a wall with a small hole (due to 
Sasimir ’(13])Yo"Let ny and No be the number of moles of an 
ideal gas in each compartment, and T, and T, be their respec- 
tive temperatures. 


In equilibrium 


OT pe? 


Ty ere pecs 4k : (3.64) 


For an ideal gas, the energy u is proportional to 


nit, so conservation of particle number and of energy gives 


the following conditions on the fluctuations ny > Sno 5 61) > 


and 61): 


én) + bn»y = 0 


Pans. (3.65) imply : 
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i 2 z. 
CE ee BO 8 E (3.66) 
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For an ideal gas. 


S = nC. Pipers Rela = a Renin : (3.68) 
Manipulating yields 
nc 
a V tm KR Z 
AS = - m2 (ST,) iz (Sn,) (3.69) 


to first non-vanishing order in the fluctuations. 
Transforming to new variables ay and oF and 


conjugate forces X, and Xo where 


Oy = Ons 
Qo = buy = (Ton, + ndT,)C, (3.70) 
gives : 
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the mass and energy flows on, and 6Uy >» then the linear 


phenomenological equations are 
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In eqns. (3.73), Q is a heat convection coefficient 
ew 1S a heat conduction coefficient. If, in order.to 
apply Onsager relations, eqns. (3.73) are put in terms of 


Qt» Ao» Xi > and Xo then 


2 Ce elke + B)X, 
do = (y “O2y)x, + t au + BQ + w)X, (3.74) 
and the Onsager relation is 
be son ae (3.75) 


[feasteaay state is, 6s tablianed om =)10) whileuc 


temperature difference is maintained, then 


sn = - BSD C764 
T 
$7 
or Sh =. (YT - Cy) RF (3.77) 


Panes (oe 77) relates the concentration *diirerence caused by 
unequal temperatures, to the energy carried by the molecules. 
ire value of Q may be calculated+from kineticotheory. — it > 
is the diameter of the hole and A is the mean free path of 
the molecules, then there are two limiting cases. 
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Eqn. 7(3. #8joresalts iim Knudsen's formutka 


~ cons tan & 
n(T) = pi ATE . (347.9) 
(Za eeyaa cro tien, 0 = (Cy oe ARE 
SO 
on = — oT 
n i 
or fh ee ee (3.80) 
6T : 
which yields 
n(T) = constant P (35.814) 
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Inehas 1945 paper, Casimir [Vojealsoediscusses haat 
Conauction in an *anisotropic crystal. “Im this and many other 
common systems, the relevant forces and fluxes are not such 
Simple quantities as én and ou, but rather field variables 
(e.g., VT(r,t)). This necessitates the consideration of 
time derivatives of integrals of field variables over regions 
Onuspace, Ln the example ofeheat conduction.» this =resulés 
in an Onsager relation weaker than the statement that the 
heat conduction tensor is symmetric. Instead, it may be 
concluded that, if x - X(s) Reds), ee eee is the anti- 
Symmetric part ar olt then 
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<“_— + (VT) = 0 (3.83) 


for any T(r,t) whatever. Cee. TS CONS tant. pecas imi Pr 
mio argues that it js only V -X that is of physical 
importance and so that it is permissible to set 72) = Oh, 


which gives the Onsager relation 
= } f 204") 


While it is true that the differential equation for T(r,t) 
involves only Vv - ne Tt 1s: still possible to have boundary 
conditions which aoe: 3) itself. For example, ata 
thermally insulated boundary, an appropriate boundary 


Condition is 


TMi ko) Gutieed) a oat eG) 
where n is a unit vector normal to the surface. An experiment 
which would in fact iacertmtgo Gee is described by Truesdell 
Mi-ep. 14. In tacts. the classic neareexperimencs Ota o0Ge6 
and Voight claim to measure A itself. 

Onsager [13], however, claims to show hate? = 0 
directly, in agreement with the experimental evidence. 
However, as he considers the entire crystal rather than a 
mycrascopice volume of 1%, 1t 1S not Obvious how the Onsager 
relation he derives is valid for the local heat conduction 
tensor in its usual interpretation. The situation and the 


parameters Onsager considers do not generalize easily to the 


experimental situations of Soret, Voight, etc. 
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peor Ser Mini mume Entropye Production 

[n@tneshieoryeor irreversibile processes: there: is 
an important class of processes which playsa role analogous 
to that of equilibrium states in reversible thermodynamics. 
These are the steady state processes which are characterized 
by time independent forces and fluxes. This situation differs 
rromrangequidabriumystate by the fact that, due toothe 
appdication of constraints, some forces and fluxes are non- 
Zerowand hence ‘that the entropy production is non-zero. 
These stationary non-equilibrium states are sometimes 
characterized by a minimum of the entropy production (consis- 
tent with the constraints), analogous to the maximum entropy 
of equilibrium states. 

Minimum entropy production! asevalid? only for 
Certain conditions and, in order to derive 1t. it is 
necessary to assume linear phenomenological laws, the 
validity of Onsager's theorem, constant phenomenological 
coefficients, the constraints result from time independent 
boundary conditions and that there is no mass convection. 
These assumptions restrict the systems considered to those 
am which there are no large variations of the parameters 
Meno. etc) wover. ther entiregsyS Lem. soa ISetomnecesca uy U0 
ensure that the phenomenological coefficients are constant 
throughout the system. 

The simplest way in which to present this theorem 


is through several examples. First, consider transfer of 
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matter and energy between two phases of a material which 
are kept at different temperatures. Once steady state is 


reached, there will be no mass transport (J. = 0) but there 


will still be heat transfer (Jo 2.0). einen, 
of. EY, a ee ee a) P (Src o) 
Assuming linear phenomenological laws of obeying Onsager's 


theorem, 


X (3:58) 


where Lio = Loy» the minimal property of Oo. may be derived. 
moves tedadye Svate, Ji = 0 and in order to see the 


connection with entropy production observe that 


X = 2d oe 3388) 


aus. Uf. 0. is. a minimum (subject to the constraint on Xa) 
aac =o? (3.89) 


This means that, “ef the system is in a ‘steady sstate, 


then the entropy production is a local minimum (not a 


maximum since o. is a positive semi-definite quadratic form). 
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A second example is furnished by thermal conduction 
mean’ isotroprcemedium. winwthis: case (cf. “de Groot*and 


Mazuve ia dup. 45), 


eye 
Gg Ped eee ae) (3.90) 


and the phenomenological equation is 
3, = bag WCF) (3.91) 
Somtne total entropy production P is 
Peed o eave-eyatee (vil) . e(2 yay (3.92) 
vy qq T a ; ‘ 
V V 


ine solution of eqn. (9.92) is, frompthe calculus of varia- 


tions, 


v* (zt) = 0 (oe) 

or ae. =e : (3.94) 
The local energy equation is 

ey che > (37.9'5:) 


Q v ot q 


so, for a minimum of entropy production, 


ou. Q (3.96) 


and there is a steady state since heat conduction is the only 


process considered. 
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Note that Onsager relations were not needed to 
derive the minimum entropy production theorem for heat 
conduction. 

It can also be shown that these steady states with 
minimum entropy production are stable with respect to small 
hocal “perturbations. To show this for heat conduction, 


differentiate P with respect to time to get 
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a eed = 2p (oe my er 13297) 
me 


Wien eh fixed on the poundary 2 , 


gP _ BCS 3182 
== 20) 5 (ap) dV a0 (3.98) 
V 


Since 0p, ome and T are positive. 
Thus, since P decreases with time, the system 
returns toward the state of minimum entropy production and 


hence the steady state is stable. 


More general linear phenomena may be considered 
and similar minimal and stability properties of steady states 


may be derived (cf. de Groot and Mazur [4]). 
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It is also possible to derive an evolution 
criterion without the use of the phenomenological laws. 
This criterion is not restricted to situations where the 
coefficients are constant or where the Onsager relations 


are valid (cf. Glansdorff and Prigogine [15]). 


Writing 
Pas f o. dV = fz X.Y. dv (235499) 
r i 
ap Ee O15 
1 1 
Vv V 
This may be written as 
Ja6 ou 0 
are ee ea (3.101 
V 
3 3 « e ° 
where ae and = denote the portion of the time derivative 


which results from the time variation of x. and Y; respec- 


tively. Then, 


Te ene Ae (3.102) 
: 


Mie Validity of (3.102) is again most easily seen by example, 


as)in de Groot and Mazur [4], p- 54. 
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This "general evolution criterion" may be inter- 
preted aS meaning that the part of the change in entropy 
production due to the changes of the thermodynamic forces 
will always be negative, although nothing may be said about 
the total change in entropy production without more restric- 
tive assumptions. 

The question of stability of these states and 


others will be considered in more detail in the next chapter. 
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CHAPTER IV 
STABILITY AND FLUCTUATIONS 


§4.1 Liapounoff Functions and Stability 

In considering general thermodynamic states, the 
Subclass of stable states is of obvious interest. In many 
applications. it. is, the. properties of,a system after, the 
transient phenomena have died out which are of interest. 
Examples of such states, which are known from experience to 
be stable, are systems in equilibrium and many steady state 
transport systems. These are stable in the gah pave sense 
that, if a small change is made in one of the parameters, 
then, left to itself, the system will not evolve to a state 
much different from the original state. 

The idea of stability can be more precisely formu- 
Fated in terms, of.liapeunoft functions... If x denotes the 
independent variables characterizing a system (e.g., volume, 


energy, entropy, etc.) and if i is the value of x att=t 


1¢) 
then 
2 ee i te OOD am (4.1) 
Defining 
Un ltt, yd 0) ee esr) (4.2) 


Fe . 
where § is some deviation from the state Xo thens.it fox 


all « > 0 there corresponds a function, k(e) > 0, such that 
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the system is said to be asymptotically (or completely) 
Stable. Asymptotic stability implies that the perturbed 
and unperturbed states will evolve toward exactly the same 
ove as t >. 4icem, Tluctuations die out). 


-) 2) 


Aseauresuiae. it el < 0, then the system is 


Stable and if oy") 2&9 Cheon Pall YY s"thelsystem 75 asympto- 
tically stable. Choosing another positive definite form 
rather than y? would yield different sufficient conditions 
FOr "Stability. 

It is important to notice tat the above stability 
theory applies both to infinitesimal and to finite pertur- 
bations e ands aot restricted to'steady istate “situations. 
However, in many cases, the stability problem cannot be 
completely solved and stability with respect to infinitesimal 
perturbations 1s ‘Of interest. ‘If +t ™rs "stvown ‘that va "system 
is not stable with respect to infinitesimal perturbations, 
then it is *completely Unstable” ‘Wowever, eVen “if¥a "system 
Ts stable Wren “respect to infinitesimal “perturbatrons:) 1 


may still'be ‘unstable with respect to some finite ‘size of 
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perturbations, in which case the system is called meta- 
Stable. For example, a particle at the bottom of a finite 


potential well with finite energy barriers is metastable. 


Soca lLaDl lity Of, Equilibrium States 
Before considering the question of stability for 


general thermodynamic states, the classical (Gibbs-Duhem) 


theory of stability of equilibrium states will be considered. 


In a reversible process, the first law of thermo- 


dynamics states that the heat received by a system, dQ, is 
dQ, = de + pedy (4.5) 


where dE and dV are the changes in the system's internal 
energy and volume respectively. 
For a closed system at uniform temperature and 


pressure, the second law may be written as 


2 aQ 
dS = dS + d,S 3 ¥ (4.6) 


Or alternatively as 


Td.S = TdS - dE - p dV > 0 CAE} 


where the equality holds only for completely reversible 


processes. 


If AE, AS, and AV are the small but otherwise 
arbitrary deviations from the equilibrium values of E, S, 


anaev. then the following condition for the stability of the 


equilibrium state is deduced: 
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Nera pV p- GT SAS Ys 4G : (4.8) 


Mar is, if no state which starts at equilibrium can change 
in such a way as to satisfy the second law, then the system 
must remain in equilibrium. 

In the special case of constant entropy and volume, 


ene stability criterion is 
IE 0 ; (4.9) 


That is, the internal energy is a minimum at a stable 
equilibrium. 
For the important special case of an isolated sys- 


wempSdEr+ ipadV = "0 ses "the stability! criterion becomes 
AS ¥e70 ; Ce 1G) 


That is, entropy is a maximum at stable equilibrium. 
If now the entropy density s is considered to be 
a function of a set of independent thermodynamic variables 


Cones... Ve. sand BNE then As may be written as 
ASai= a OSa 5 OS char (GAvalals) 


where 6s is of first order in the deviations from equilibrium, 
pee 1s of second order, etc. Then, in order for the system 
to be in equilibrium (entropy a maximum), 6s = O and the 


stability criterion for infinitesimal perturbations is 
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LO tiydmanexplicit form for 55), consider the 
independent variables u, v, and foe Then, since they are 


independent, 
SURE eo NV = 6 Chceng 4 (Gar) 
Starting from the Gibbs-Duhem relation, eqn. (2.60), gives 
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Writing ote di cerms, Of 1, Pp, and ey and manipulating (cf. 


Glansdorff and Prigogine [1] p. 25) yields 
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Since the perturbations 6T, 6v, and a are arbitrary, 


this implies 
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cna 50 (thermal stability), 
Yel) (mechanical stability), 
N 
and d 0 6 cae iT 
coi hie c, 5c, 0 (stability with respect 


to diffusion and chemical 


reaction). (4 is) 


These are nearly obvious conditions for a system's 
Stabiiity.  Havang Cae QO merely means that removing energy 
must decrease the temperature; xy > 0 just means that the 
compressibility must resist any volume change, not aid it. 
The final equation above is also easily interpreted although 
ate 1S not, as fami ivan as the other. twor 

This classical theory of stable equilibrium works 
well in systems for which a thermodynamic potential can be 
defined. This issquite restrictivetsince’ it is known that 
in an experimental situation, stability is -controlled by the 
boundary conditions. For example, in a solid, thermal 
equilibrium is established by a boundary condition e1 ther of 


a uniform temperature or of no heat flow on the surface. 


This is of even more importance in considering non-equilibrium 


Steady state situacrions. “Hence 10° is }desarabie to formulare 


the stability criterion in terms of the balance equations 


and boundary conditions. 


Fiystipthe equilibrium stability theory 1s) reformu- 


lated. For the total system in a volume V, bounded by a 


Surface Zz, 
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0 
se = P[S] - ofS] (4.19) 
where PLS} =f Ne JOSE ey (4.20) 
RS bse 
is a source term and 
Ost =o gee Bi) 
i} 


is an entropy flow term. 


Writing 


Sect were. (40224) 


where 6S is of first order in deviations from equilibrium, 


525 Loonie se COld 40Ibde'e,..C.6C 5, OTVES 


a a(6°s) (4.23) 
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valid to second order. 
Néxt; sphitetP£iS]e-tolS ]Foimtontermsrofyfirst and 
Secondnorderee! Firstyecnote i that, since x. = Y. = 0 in 


equilibrium, P[S]-issof second order. »Then, write 


soa ica ems aE 


where es isfot first order sand g(2) 65] is of second 
Guders I te1sapoSsible LO rind: exphi cit expressions: toy, 


gM 553 and g(2) 65] from the equation 
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3 vaennr dite 
moles J tos! = 2 See oy a. (4.24) 
r a 


Since V = 0 on £ for a closed system, and if ifn 


u 
and = are written in terms of their equilibrium values as 


ee - 
Wee Tag vied 
and one Ge) + ACL ae (4.25) 
ve Y eq Y A 
al Nios 
Mriense ob Sy Supteetebet retpsty rofl ifineseys (4.26) 
i a Te eq) Tey. 
5 eq y=] 
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y ny 


Equating the terms of the same order gives 


O05 ae (os) 
($5) - . gl) Ts] 
2 
and PROSE pS] ee to ee (4.28) 


These equations are valid in this form only for systems at 
rest (no velocity fluctuations). In the presence of velocity 


fluctuations, NID! and 6 ts 7 contain additional terms of 


second order. 
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KanGl) 
GS a= Pag eps year see! (4.29) 
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Note that, if the system is isolated, o | drs] = 0 and the 


eoualibrium comditron, 6S = .0)%is recovereds For a non= 


cots 


Le oe m vl 
(Kb oY) ee Se | < vea) 1 ae 


ne 
vi 


r4\ ; be _ 7 
say 2 §BtDTS BetOF Ss RO g « V apne a i 
a 
os ceaul ryAtfiues eset. Oo Sarted at nate ie] thle . 
| are 
- “TA . a = a “9 
a pe Pe 
c 7 LA i=> => 
t¢ Jee, FF nes fey i 7 ~ 


vi mip 
(* +) Diet OR 7 i - tej! v 
t= F x : 


29Vid ~Ab20) SNS2) Baas ar anne one 


roi ht Ne . tae | a 


(as) 7 ee: sar baa iy: be sy 


at 6 emeadeve 10" OS MUOF “21S KN ay 576 motte 8 sesr 
eiPoolae FU osns2s;4 ony ‘AI ahead 500% et 
6 emis) fenotithobsa nisdndes roy yng 


é 


AT hy 


.bsisloet. er met 
Ul 2. 7“ 


ye 


isolated system; it is seen that eqn: (4:29) is a generalized 
equilibrium condition which implies that a small change in 
the system's entropy is compensated by a flow through the 
Surface. 

For the second order equation, an assumption is 
made about 9 (24) 55), It is assumed that it is possible to 
maintain the boundary conditions on the average. 

This does not necessarily mean that there are no fluctua- 


tions on the surface but rather, for example, 


t i 
eMC Toe dts 00 (4.30) 
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ferat 2>.a,7Wherertgis some) time,scabesfor fluctuations. 
Since the stability of interest is for time scales greater 
than that of the fluctuations (these fluctuations may be 
regarded as the initial perturbations), it is permissible 


to set (2) 55] = 0. Therefore, 
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This then gives the condition for stable equilibrium 
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where @61S the initial equilibrium state and f 1S the final 


state. The criterion may be rewritten in terms of NaS Since 
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Os: <0 (4.34) 
which immediately implies that chy? Undyv4e Oshand 
N : 
2; Hama bey Seyi: > 0 as before. 
ess 


Thus, even for the more general situations where 
equilibrium is due to boundary conditions and no thermodyna- 
mic potential exists, the same necessary and sufficient 
conditions for stability are derived as previously. Of 
sourse, the above conditions, holding only at equilibrium; 
PapnOteensure that the equilibrium 1S,stable agains finite 


perturbations. 


84.3 Stability of Non-Equilibrium States 

Next, the above theory will be generalized to 
include non-equilibrium processes. Only linear stability 
(small perturbations) will be considered. However, this 
includes hydrodynamic stability problems, such as the 
onset of convection or of turbulence, as well as purely 
dissipative processes such as chemical reactions or 
thermodiffusion. 

For the stability of non-equilibrium states, both 
the assumption of local equilibrium and the concept of 
Liapounoff functions are used. If the function y?(t) is 
chosen as a Liapounoff function (where y(t) is defined by 
ean (4,2)). then a susfitient*condition for stabi lityers 
ay" (t) <0. If the independent variables are u, Vv, and oe 


ot . 
then the criterion for asymptotic stability becomes 
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Note that if the quantities su, Sv, and iy are the devia- 


tions tfromiabsteady ostate; then u = du, Vv = 6¥, and 


Ey = 8c, So, thewconditi-ons for stabi lity sotea siteady state 
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However, Since the quantities appearing in these inequalities 
do not appear directly in either the balance equations or the 
pouUnadary, COnNdltions, another Liapounoti tunction 1S SoOUugKt. 

Pt is atuetnis point that thewmassunption of, tocal 
equilibrium is used. It is also assumed (in agreement with 
experience) that the local equilibrium is stable. In a non- 
equilibrium state in local equilibrium, with temperature 
distribution T(r), the thermal stability condition would be 
that 

oe Leah es Che (4037) 


Thus; t0r Stable local equilibrium, Se < 0 everywhere. 
Therefore, (- § #3) may be used as a Liapounoff function, 


Givingvas a sufricient condition for tocal stabriity; 


2 (6*s) 30 (4.38) 
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Integrating over the entire system gives 


Kos) Se ee (4.39) 
with the stability critericn 
3 2 
at ove) 2) °O : (4.40) 


NOtewtmat thls. Criterion 1S °SUsFiCcilent only for 
Mimomrctesimal perturbations.  schlog! [lo], using a Statisti— 
cal definition of entropy (essentially at local equilibrium), 
has shown that, for finite perturbations, -dy,S 3 0 and 


Cis that a SUPfTCaent CONdGi tion TOY Stability 1s 
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ne (6 


Wie eeu (4.41) 


where by 5 isethe® part of AS which 1s9non-linear in’ the 
deviations from equilibrium. However, since the Gibbs 
formula is a first order condition, its validity alone is 
not enough to ensure that by 8 < 0 Jandel teds necessarys.to 
assume that S has the same functional form as in equilibrium 
to all orders. This is a considerable extension of the idea 
Gre kocalicquiliorium. “Also. the practical valuemon “tinic 
Condition 1S limited by the need to calculate AS ‘and + NS!) 


exactly. ln the limit of infinitesimal perturbations, the 


Stability criterion reduces to that of Glansdorff and 


Prigogine [1], eqn. (4.34). 
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Note’ that’ “the stability criterion given above’ ap- 
plies to any non-equilibrium state provided the system is 
in local equilibrium. However, for time dependent states, 
stability involves the difference of two separate time- 
dependent solutions corresponding to the perturbed and 
unperturbed motions. of the system in the parameter space. In 
Steady state situations, stability is concerned only with the 
deviation from a time-independent initial state. It is this 
Simplified situation which is usually considered. However, 
in situations where more than one stable steady state exists 
(e.g., thermal steady state of a temperature dependent 
resistor - Schlogl [17]), the question of whether a perturba- 
tion of one steady state would cause the system to evolve 
towards another steady state may be of interest. 

For an example of “a Stabilwey scriterion, consider 
Oneisotiermal, Linear, passive electrical, circuit (cf. 


Bessenrodt [18]). Then, 
Oies 0s — so mE oes Dieta pie ee (4.42) 


If it is assumed that there are no density variations (é6p = 0), 
no inductive elements (SB = 0), and that the system is iso- 


thermal (éT = 0), then, 


Pa be us = , 
6T = 0 = = Su + (WoT) + SD (4.43) 
= ) 
where (Vo); = 5p. 
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then éu = 0 and 


oTé6S = - E . 


for an ideal capacitive network. 


Criterion is 


CYTO lis BS uch than vee ‘a0, 


ép (4.44) 


Therefore, the stability 


pTé“s = - 6 « SB = - (¥F) : 68 8B < 0 (4.45) 

For a parallel plate capacitor, E || B, and hence 
2% (8D)* > 0 (4.46) 
or ae eae) CAA) 


If the capacitor has plate area A, plate separation 


d, charge Q, volume V = Ad, and potential difference U, then 


Toss Ciieinoecs ai = 
V 
arian. tae), 
and E = ae D r 
Be UA 
Thus, D 3 Q 
pegs aeU 
2% | bcos 
269 
and 6D = A 


Iherefore, the stability conditi 
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= ud 
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; (4.50) 
C4513) 
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Hence, capacitance = a -0" TOY as tables linear vCa0act tor” 


This can be generalized to systems with inductances 


& 


and generators. 

It was noted previously that it is not necessary to 
use B25 ds tne Erapounorr function. “Instead. any positive 
definite quadratic function of y(t) could be used. However, 
Glansdorff and Prigogine [1] argue that 6°S and a(67S) 
involve quantities directly derivable from the balance 
equations and boundary conditions and hence BOS TS the! 
easiest quadratic form with which to deal. However, a more 
convincing reason to use Ses is seen by considering the 
connection to the theory of fluctuations. Denoting the 
ByODdDIWIty Of realizing a givenTS tate sm, by Wee then from 


statistical mechanics, 
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then it is known that 6S = 0 at equilibrium and near 
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between stability of equilibrium and the condition 6°S < 0, 


Tsenot SUT ficient tosensune stabi kityae lt 1s also-necessary 
Pomnave anyatlucéuations die out (i.e., a(S) =e Ome 

An example which serves to illustrate several of 
the points previously covered is that of heat conduction. 
The equations for the heat current ie and the entropy pro- 


duction o. are 


s 
ity = a Tek 
where X= ¥(+) 
cae +72. OU @ 
and Pefico dv = | So (VT) + (¥T) av 
v V 


Spliteing dr into ta and dP as in eqn. (3.101) gives 


~ > ~ 
= > . = Pada ; oes, 
iD Siete Bp Sasa acys? 2? 1, (4.59) 
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ey oh rahe aK 
Techs f Jq ae dv (4.60) 
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Assuming only dissipative processes are present (i.e., no 
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Assuming that the boundary conditions are time-independent 


gives 
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Thus, in heat conduction, the thermodynamic forces change in 


such a way as to lower the rate of entropy production. 


Assuming the quasi-linear phenomenological law of 


eqn. 14,56) gives 
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ara 20 = 0 if and only if T(¥) = Tet) provided the boundary 
conditions are time-independent and the system is near its 
Steady state. 
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Gune,tion. which, shows, the steady state 1s stable. 
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So this can be regarded as a generalization of the minimum 


entropy production theorem. 


84.4 Stability and Fluctuations 


As before, stability may be interpreted as a 
Sant inty against Fluctuations. Then, bee) is the average 
r 


temperature in steady state and T(r) can be regarded as a 


( 
fluctuating temperature, near Daigle analogous to equilibrium 
miuctuations Of local temperature. The situation s1s 111]us- 
traced in Frqse’ (4ut) and® (4.2)% 

The idea of a fluctuating temperature is most 
easily understood in terms of Einstein's fluctuation formula. 
For fluctuations about equilibrium, to first non-vanishing 
order, the probability W of a state is 
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gives the probability of a temperature distribution 


T(r) = ie a $T(¥r) differing from the average equilibrium 


temperature i. - The Einstein formula can be generalized to 
steady state situations as 
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Temperature fluctuations about steady state 
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where T(t) is the steady state temperature distribution. 
However, before this simple interpretation of 
fluctuations can be accepted, there are some basic questions 
about the nature of fluctuations in a thermodynamic system. 
Burst Ofedhilwdit usurealized that»classicalvequilibrium 
thermodynamics considers all parameters to be continuous 
variables which cannot fluctuate. This is basically due to 
the fact that matter is assumed to be continuous, ignoring 
Pecaierosecopic Sstructure.+: in ,ordersto inchuderthis struc- 
ture in the theory, equilibrium statistical mechanics is 
needed. This theory admits fluctuations as deviations of 
Statistical quantities from their average values. This may 
be interpreted as meaning either that the various members of 
a statistical ensemble have different values of that para- 
meter or that the value of that parameter for a single sys- 
tomzsElLuctuatessi ns times, -In-ordere toyseeiwhich+quantities can 
fluctuate, care must be taken to separate the various ensem- 
bles. In the microcanonical ensemble, the mechanical 
Guantities NeaVesand.E& (theanumber of pagticiles.,the volume, 
and the energy) are fixed so there can be no fluctuations of 
these extensive parameters. In a canonical ensemble the 
energy is.no longer fixed since the. system.is not. isolated. 
In such an ensemble, temperature is introduced as a Lagrange 
multiplier, so it is meaningless to speak of fluctuations in 


temperature. It is also meaningless to talk, for example, of 
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temperature fluctuations in a microcanonical ensemble since 
the very concept of temperature is ambiguous in such an 
ensemble. Indeed, if a "small" thermometer is inserted into 
an isolated system, "temperature fluctuations" would apparent- 
ly be observed. However, by inserting the thermometer, energy 
exchange is allowed and the energy is indefinite after the 
measurement so the ensemble is no longer microcanonical. 

In general, the ensembles considered can only allow 
fluctuations in the extensive variables (e.g., E, V,; Nina 
grand canonical ensemble). These parameters are mechanically 
defined and so are unambiguous, regardless of the presence of 
fluctuations and independently of the size of the system. The 
thermodynamic intensive variables (e.g., T,; p, nu) are then 
introduced. These are defined unambiguously only for 
ensembles in which they are constant, hence temperature is 
ambiguous for a microcanonical ensemble but not for a 
canonical-ensemble where itsis constant. sThisnconstancyyis 
@ecerhectionsof the fact<+thaty.tnaequid ibri unsithesegintensi ve 
parameters are defined to be those of the reservoir with 
which the system is in equilibrium. Thus, these parameters 
are non-fluctuating quantities by definition. This is also 
seen in thééfactuthatethesedparameters enter theetheonyeas 
Lagrange multipliers and not as statistical quantities. 

Theyvapparent conflict«withsthe intuitive ifeeling 
that gurf tpartichecand renergy densities are fluctuating, the 


temperature cannot be constant is explained as follows. 
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In equilibrium, the constant intensive parameters 
pevereco the System'as a’whole? "By*therr’ very =nature ,= they 
exclude local*vartations*or-Tluctuations. “However, these 
intensive parameters might be regarded as averages of some 
local parameter over the system. It is possible to generalize 
Ener concept sof =temperattre to include local” fluctuations. 

Since’ thes local mechanical densities s(e. 4d. 5 us os 
cv) are defined in any system, irrespective of fluctuations, 
a local temperature T(r,t) may be defined for an equilibrium 
System as the local function which has exactly the same 
functional dependence upon the local mechanical densities as 
the equilibrium temperature i has upon the average mechanical 
densities of the entire system. This "local temperature" 
will then fluctuate with the local values of the mechanical 
densities. The reason that this is no longer a constant 
temperature, as in a canonical ensemble, is that if a small 
portion of the system ts considered; the presence of signifi - 
cant energy and mass density variations in such a region 
preciudes 1t from being in equilibrium with any reservoir 
and hence it cannot meaningfully be described as having the 
temperature of some ideal reservoir. 

It should be noted that this local temperature no 
longer has a close relationship with the Lagrange multiplier 
ly. which describes the system as a whole. Also, it is 
Opvlousethat. an order for the local temperature” tombe va 


physically meaningful and measurable quantity, its fluctua- 
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caons must be much smateer than its value... This is also 
reasonable since, in fixing the functional dependence of 
T(y,t), fluctuations were ignored since there were none in 
i 

AlSO5. aS aeSyellear from this approach to the local 
temperature, it is quite unnecessary to have such a function, 
except as a salve to intuition. What are really of interest 
are fluctuations in mechanical densities and these fluctua- 
tions are cast in terms of a fluctuating temperature only by 
assuming the functional dependence of T(r, t) on these 
mechanical densities. 


This: is also clear from the approach due to Landau 


and Lifshitz [19]. There, the expression for of is 
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where the partial derivatives are determined from the 
equilibrium functional dependence of le upon (E/V) and 
Wij. huss thevresults referring toe tempenatures fluctua 
mions. (@7g. 4, eane (4.14) ) anes notiInecom@inctawietnh the adea 
of intensive thermodynamic parameters as constants. Rather, 
this is a convenient way of expressing results which 
originally referred only to fluctuations in u and v. Indeed 
an bendau and lLitshitz 19], Pp. 351, the original expnession 
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where is and he are cansitan.ts , and Nitmis only through: a 


formal procedure, as above, that this becomes 
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CHAPTER V 


CHEMICAL REACTIONS 


fee equations of Motion and Stability 

Chemically reacting systems will now be considered 
as examples of systems which may exhibit steady states both 
near and far from equilibrium as well as other quasi-stable 
States (e.g., sustained oscillations which may be sensitive 
to perturbations). 


Consider a system of chemical reactants with mole 


numbers nv (vols cee eect). It there Wsmone chemical reaction, 
then 
= d ae 
dn. oY 3 ( ) 
th 


where y is the stoichiometric coefficient for the y 
component and € is a parameter describing the advancement 


of the reaction. 


tl 


If there are "r" simultaneous reactions then 


de (Gon) 
\ vakS cleat weed 


where ae ns .the:stoichiometric.coeffiiaei ent .of .the yon 


reactant in the 5 th reaction and Es is the advancement of 
the g th reaction. 
If the velocity vs of the sth reaction is defined 
as d Es 
Ves = Vd 5) (5. 3) 
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then 
dn r 
Te Qo nmaaae (5-4) 
6=] 
To clarify the notation, consider the simultaneous 
reactions: 
O&O Sr 0. eee GO (S=1) 
Cars 0, ve C0. (S=2) (5.559) 
Then, 
dn. = -2 dé, ~ d&>5 ; 
vhs = - dé, - dé, ; 
dneg =e dé, ’ 
and tng. = dé, } (55.6) 


If the possibility of open chemical systems is 
included in order to have steady state reactions, the 


equations become 


where dally is the external supply of reactant y 


Recalling now the Gibbs-Duhem relation gives 
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where the affinity of the ace reaction, As » 18 defined as 

: (5.9) 
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As usual, the internal part of the entropy change 
is considered, yielding the entropy production P as 
dz.S 
1 


egy ee 


1 
are Bic SG he (5.10) 


Also, recall the Gibbs-Duhem relation for chemical 
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C u ia, ny, hy: r , dA wit 
ysy'=l one, CHEE Ka On edit 
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If the affinities are regarded as the generalized 


forces and the reaction velocities as the currents, then 


r 
T dy P = we Vs dA, < 0 : (G5mnds2s) 


In a steady state, the forces and fluxes are 


constant so dy P = 0 which implies that 


dy a= 0 : (5ieuli3a) 


S52 “Examples 


The following example serves to illustrate some of 


these results. Consider three reactions: 
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(aren eas 
us Ga ee (5.14) 
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Ay = Uy > iy 
Ao = Hy - Up 
A. re thaent Ces) 


TO ‘get a steady state situation, keen Np and Np 


fixed by supplying them externally. This means that Uy and 


Up are fixed. Then, 


A, 1 A. = Uy - Hy = constant (5.16) 
sO dA, ted = 20 : (coale7 a} 
Since this is a steady state, 
3 
i dy P= Q = = V5 dA. Cons) 
6=] 
or (v, - Vo) dA, tes dA. = 0 (5.19) 


for any dA, and dA. Therefore, Ue and Vel S 0 
These results could, of course, have been easily 
deduced by inspection of the reaction, subject to the con- 
Straints that the system be in a steady state and that the 
reactant "M" is not externally supplied. 
In the case of steady states near to equilibrium, 
it may be assumed that the equations are linear in the 


deviatrons from equilibrium. upFor texampley in ethentinégar 


range, 
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Baaeada Sa (5.20) 
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which may be combined to yield linear phenomenological laws 
of the form 
(Se 21) 


Note that Ves As = 0 in equilibrium. 

These linear laws would be expected to obey Onsager 
relations (within the limitations of §3.2). 

Due, however, to the complex form of the chemical 
potentials and affinities, it would be desirable to express 


the reaction rates directly in terms of the reactant densities 


Ns rorrexample y'for*an 4ideal “gas, 
3/2 
J (2amkT) Noe 
Ue aa Ro en Dirt Ne (ice) 
and, in the previous example, 
My Ohic Ny 
A, = Un = Uy Sola VER Bo ae ay! ° (5.23) 


WaPthe light of -this "compres ‘dependence ot wine 
affinities upon the observed quantities Ne» Tt is Usuaely 
easier to guess the dependence of the reaction rates upon the 
Concentrativons, "rather than upon the affinities themselves. 

For example, considering the transformations of A 


Darkticies into B particles through collisions with another B 
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particte “in tardi lute gas seit isi\reasonable ‘toatassume.that 


the rate at which the A particles 


CPan's FOrM om como, particles 


is ’pyoportional to the concentration of A particles and to the 


concentration of eB parttcles.. 


Also, if there is a reverse 


BeaGuronowitn twoubos COlliding to yield anf tand 6 B.. its 


rate would be proportional to the 


Square of the concentration 


Hmbepattiches. That is, for the reaction 
A+B <= 2B (5.24) 
it would be assumed that 
Ate Kynan, - Ky ne (5525) 


As an example, consider 


tnerstabikity sand steady 


State properties of a slightly more complicated model of a 


chemical reaction due to Schlogl 
are 

Alt 2X => 
and Boat a x 


The concentrations tof AY ‘Byeand VG 
Only the amount 
dn 


steady state occurs when i = 0 


external supply. 


A particles disappear, and r,, at 


are assumed to be 


and 


[20]. The relevant reactions 
3X 
C ; (52.26) 


are held constant by an 
of X can vary and the 
The rates rie at which 


which B particles disappear, 


(5/2270) 
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With an appropriate choice of units, Ky = Fand Coens 3 
The net rate of change of ny is then 
dn 
oe : - S fh 
ite eo eae o(ny) ee ae: 3ny Bny ny (5723) 
where b= Ko Np and y = Ko Ne 


The steady states of the system are the solutions 
of the equation 


- 3n¢ 


y + Bny é (5.29) 


PenOUGnEDLOtL=OT y vas) a TUNCTtION ‘OF ny for different values 
of B is Gi Vene inaeiiG..a5. |. 
For 6 = 3; therecis only one steady statevalue of 


ny for any y. For 8.< 3, there -are three separate steady 


(3) 


C17 be’) 
State values Ny folly > and Ny eae for eee SE V> a For y 
Outside) this range,-there is just-one steady state. 


dn 
By considering the sign of a near each of the 


(1) (3) 


steady states, it is easily seen that ny and ny 
) 


pond to stable steady states, while nv? corresponds to an 


COTS = 


unstable steady state. 

TtcWas been pointed out by senlogiv | 20 \ethet it is 
possible to have both stable steady states existing simul- 
taneously ana single system, 117 diffusion is meluded =i netic 
evolution equations. Under suitable conditions, there can be 
two coexisting “phases” in a vessel. separated (by a bougdary 


layer thin with respect to the dimensions of the system. 
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hor fsomeechemical isystems soit risvalse possible to 
describe the motion slightly away from steady state. In the 
following model, a steady state is found which is not 
asymptotically stable and sustained oscillations of the 
reactant. concentratawons result. 


Consider the following system of reactions: 


Rute be x (rates Ky: Ky) 
Nod You) 32 (rates Ko» K 5) 
Venee ee (rates K > K3) : (5230) 


inevconcentrations: of the™iniGgral reactant A and 
the final product E are externally maintained at constant 
values. Only the concentrations of the intermediate reac- 


tants X and Y are variable. The equations for ny and ny are 


dn 
eae he gets airs 
Aree Bigs Spy gece ate 
dny ai 
and ae Ko Ny By 7 Ko Ny “Ka Ry + kKQ ne (Gash 


where the primes denote the reverse reaction rates. 
Now, assume that the concentrations are maintained 
at values for which the affinities, become so lange that tne 


reactions proceed in the forward direction only. Then, 


ignoring reverse reactions, 


and dt = sy, Ny ny = ae Ny (Sse) 
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This system, incidentally, is isomorphic to the Lotka-Volterra 
model of prey-predator interactions. 
Eqns. (oe32) have one steady statersolution (apart 


from the trivial one ny | Nye Os) 8 That So lancron es 


aids views OF n (a3) 
if K A ” : 


rovanalyser the stability of sthie steady state.a 
normal mode analysis is used for small perturbations. Assume 


a solution of the’ form 
wt 


wt 


ib ae 
ny(t) pony ny e 
; + on 


y & (5a 3Ay 


) 0 0 
where [ony | << [ny| > | ony | << Inyls and w may be complex. 


imen.s tO tirstvorder in the perLurbdations ; 


W ony + K 3 ény = 0 
and Seka ten ény + Ww Sny = 0 ; (58°35) 


Dea | a CSe 360 


so w is purely imaginary and there are undamped periodic 
fluctuations about the steady state for infinitesimal 
perturbations from that steady state. This is an example 

of weak (non-asymptotic) stability with regard to infinitesi- 


mal perturbations. For such perturbations, it can be shown 
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for walansdovit sand: 'Vigogine [7] pp. 1226) that 


so 


” 
ee 0 (5) 3a.) 


and hence §°5 1S)a non-zero constant oF the motion. 
For finite perturbations, first eliminate dt from 


the equations, yielding 


dny one oH 
any = - A” : arches) 
ny (Ny ~ kp nq) 
Pal ie 
MUS: One aaa Kp ny In ys eo) ny = constant . (5 39) 


This equation represents a family of closed curves, each 
corresponding to a different value of the constant in eqn. 
(539) ob Examples ion such, curves @rergliustrated in Fig. oc. 
Thus, the actual motion in ny - Ny space is perio- 
dic for any perturbation. The period depends upon the 
Darcvcular initial perturbation. Once the sys ten 7s perturbed: 
it will never return. to the steady state, but will oscillate 
about it in some non-linear fashion. Also, the closer an 
rOrbit. comes. to the origin, the turther the ssysvenigees 
fromethe origin-at the opposite end of the Orbit. these 
features reflect the fact that there are no dissipative 
processes represented in the equations which could act to 


limit the orbits and return the system to its steady state. 
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since this system will oscillate with different frequencies 
and different orbits, depending upon the initial perturba- 
tion, the system would be expected to exhibit highly 
Mereproeucibieroscillations’ in a physicalssysteme In 
addition, even the orbits are not stable jin the sense of 
Preavounott, since @ smald perturbation of anvorbit results 
in a new orbit with a different frequency so the perturbed 
and unperturbed motions will tend to separate. However, the 
orbits are stable in the more general sense that a perturba- 
tion will result in a new orbit, the curve of which will 
Sumi) be close to the curve ‘of the ovrigimal Ombit. 

It is possible to have a similar chemical system 
in which the final state, althougaa it. ismany OSCimaatony , 
non-steady state, is independent of the initial conditions. 
mais means that therewis a limit. cycles eoward whiten all 
motions tend as t > ~ , regardless of the size or nature ae 
the initial perturbation. This behavior is illustrated in 
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In order to get such behavior, a feedback mechanism 


is needed. Such a mechanism may be provided by an auto- 


Catalytic reaction. Consider the reactions 
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corresponding to the overall reaction 


Be D : Corals) 


iidiseeexomp le aseduer to Glansdorff and Prigogime [i] p. 233. 
This iS an open system, since the concentrations 
Tien sio. &.) and Dare neld fixed. Lteismaliso. fears trom 
equilibrium, incorporates a feedback mechanism, and has the 
interesting property that below a certain critical affinity 
for the overall reaction (eqn. (5.41)), the single non-trivial 
Steady state is a point of asymptotic stability and above 
the critical affinity, the system is unstable. The system 
exhibits instability in a manner similar to the Lotka-Volterra 
model of ean. (5.32): However, in this case, the orbits are 
for chosed Dut rather all spiral, towardssomlimiat cycle. thus, 
as st > = , the system oscillates with a frequency independent 
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CHAPTER VI 
START OLY iy FLUIDS. AT, REST (BENARD PROBLEM) 


§6.1 Statement of Problem 

In sOyGder <*tLO=gain a better InsTgnteinto they wacure 
of instabilities, the Bénard problem will be considered. 
This problem concerns a horizontal layer of fluid of depth 
d, heated from below. Due to thermal expansion, the warmer 
fluid at the bottom experiences a bouyant force. This is 
counteracted by the retarding effect of viscosity. At the 
critical temperature gradient where the bouyant forces 
exceed the viscous ones, the system will become unstable and 
thea iad/ wilt beging tos convect...-The treatments given hene 
will be quite short and for a more detailed discussion of 
chee Validity. of, the vard ous, approximations, and, of, the.results, 
see Chandrasekhar [21]. 

First, write the equations governing the system 
Whi ChydS.Supposed. to. beeso large, horizontaldye that, there are 


no edge effects present. These equations are 


an ao (ov) = 0 “KconcinuLey) : CG etn) 
e -_- 
0 (Se +¥ - ¥v) + 0 + P = pF (momentum) a Oto ea) 
oc 1) j 
and == + Vs ACU = ¥ + (AVT) - pV + V - 9 
(energy balance) (6:3) 
where o = a C6244 
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and the following simplifying assumptions have been made: 


Pe tvere sis, ony one Tivid component 


(1) 
(2) isotropic, Newtonian fluid 
(3) Fourier's law of heat conduction holds 
(4) linear thermal expansion (i.e., 
p= 9, [)= a{T-T,)]} 
GoJmspectiic heat. is defined: as Cries = : 


Despite these simplifications, the equations are quite 


general. However, for many liquids and for moderate tempera- 
ture ranges, it is possible to simplify these equations 
further, due to the smallness of the thermal expansion. 

Then, p is treated as a constant, except in the momentum 
equation (6.2), where it is important since it is the cause 
Gf the imstabil pty. » Alsoy Nsiap ander tare consideredsétogbe 
constants. Since.p does not change, the term pv - V¥ can 
also be ignored. From order of magnitude estimates, » can 
be neglected in the energy equation (6.3). With these 


approximations (Boussinesq approximation), the equations 


become 
vs, Vue Oy Mees (6.5) 
sv > >> = $0 = o> 
—— tay (VV) + — Vp = (1 + ==) Per vay CoO) 
ot Po Po 0 
and oT ey te 2 
2-+v-VT = WoT (Gea) 
ot pee, 
where 0 = ~p.9t 66 


A 


—SIDaged, SdCYebom YO? ton at kanes “pyeat VOT vvavewll ah 


aba eed Syed 2 sa zest HF uni wet Te “a | 
| Sconodmoo WHO em aoe cae ates th 
Abu Pa wt nabWe: aindinibniit (8 

nottsubiec eae i ae eis tue’ ey 


vit 
UES F 


at) co Hep neey Pound voge th ey 


" ‘ 
. 


ee TT tj »f a a 


Mei al ep sje Heb, athonge (a) 
| ne fe | 
Bi tun sie cdot issues Se seivstbko Hebe: geen 


h 
ae . 


xe 


“enoiréeups’ seaK) +t tess he shaharee at PP, Pee oie 
ghee a) mee SAN 2% pth ane: ‘ext oy gab . 
ise Hemom endo abe ry te banat ee ‘a 
§2063° 9 tv ot) oy cece SWE ceed: t aon. (aay rot 
segs baneStinad! svt oo bing ie Oe eth arin | } ed: 
| $2 V > , jes SAT S00 hips ton annb ay anda’ ¢ é: ie 
hes) 4 .asigmites sbust pein 10 soibivk tron a ‘wen i ; 
se5nd «id fw Re: a) (id ihe ye" ih ott: ar Re 
‘eteryeige 209. (no eh xo ‘eon tea eohoanatt 


Now, consider the initial condition in which a 
Steady temperature gradient is maintained and the fluid is at 
best, Then; theecemperatune and densityeasstuUnctions of Zz 


(the vertical height above the bottom of the fluid) are 


Heer is = BZ 


CH eos Za) (6.8) 


where 8 is the adverse temperature gradient. Then, since 


the equation for pressure is 


oz A gp (Gro) 


where g is the gravitational acceleration, the pressure is 


found to be 


Pp =P, - a0, (2+ 50827). (6.10) 


To study ithe stability of; such a steadys state, 
the time development of the state, after it is slightly 
perturbeds\is studied. olf v is the velocity in the per- 
Eurbedssitate,, opeis the change in pressure. and’ 17 the 


perturbed temperature distribution is 
1p lig “682 #10 (6 1a ) 


then. considering only first order terms in the perturpation, 
the Boussinesq approximate equations for the perturbations 


are 
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where z is a unit vector in the z direction. The term 

9 (52) can be eliminated by taking the curl of the second 
fe) 

of eqns. (6.12). Writing w = V x Vv and taking the curl 


again gives 
ee ae (6.13) 


where v = n/P 4 is the kinematic viscosity and 


a(vv. ) 


Pear re = go. (—+ + oe) PEN A Vv : (6s14)) 


These are the required perturbation equations. The 


boundary conditions are 


6(z=0) = 6(z=d) = v,(2=0) = Vea) = 0 : (Gamo 


The remaining boundary conditions depend upon whether the 


Surfacesmareirigud orerree.. For a Vidi a surface, Veta a aks 0 
dV 
and. Since Veve= Ose = = hat a *ugid boundary: hor sa 


free surface, 


= (Pos =e-0 (6.16) 


This implies 


dV OV OV dV 


N —_——_— ——— = Poca 
Crm a as gay) a (6.17) 
Therefore, since us = 0 on the surface, 
OV Vy 
oo ah ecer 0 G62 3.) 
end from eqn. (6.5), 
‘athe 
ee 0 (6.19) 
NZ 


on a free surface. 
SiMiabawi V1 Ore the VOrELCT GY wD the boundary 
Condi tionspare wie- 0 for a rigid surface and “2. Omron 
a free surface. 
In order to study the stability of the steady 
State, the perturbation is analysed into a eomeners set of 
normal modes and the time dependence of each mode is 
Studied. Therefore, assume the perturbation has the form 
BECK OG > heey pee 
Ve, => Vege © 4 y 


Ke etek yy) ee tee Dace 
w = W{z) a x" ve ; 


nearer Shes forty] 
@ = O(z)e ‘Shan y (le ai hy) 


where p may be complex. The equations are then 
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2 2 
p(y - k°)V(z) = - gak® o(z) + v(4y - 2)? viz) 
dz dz 
2 
a Sola 2 
p Q(z) a BV(z Beci, we - k ) O(z) 
2 
Ban Cae v(Sy - co ee (6.21) 
dz 


Choestageunvts of length: to bes (d)eandvor tame to 


be (<) and defining the constants a = kd ando = pe ~eehe 


equations become 


(emeee vera a) V(z) (2c ya ope) 
2 
2 2 oh Po. -¥ 
and GO Pag ae ccs) woh 7)) os) = ( x eavGz.) C6022) 
Oye eae 
where KS —~— (6i29)) 
is the Prandtl number and where D = S -) VE iminratang 
©Cz) gives 
2 
Mo (bo ae YER" - av - Ko)VEz) = - Rac Viz) 
(G.. 2i4,) 
Gabo CC 

where R = —— a? (Gia25)) 


is the Rayleigh number. 


lt 7s possible to show that o is purely real and 
hence thated(* o > 0, the perturbation grows and the=system 
mo unstabhe. The condition for marginal stability 1S 0 = 0: 
Eqn. (6.24) with o = 0, along with appropriate boundary 


conditions, forms an eigenvalue problem. After finding the 
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lowest eigenvalue of R as a function of ae the minimum of 

R with respect to aie must be found. = This value.«called Ro» 

is the lowest value of R for which instability will arise. 
It is possible to solve this eigenvalue problem 


exactly, ande ther resultern fo bothe sunfaces tareatreesy iisathat 


VCz)<= A sin(nmz) 
ee SNe 223 
and R = iD te eee (6.26) 


a 


where n is an integer. Therefore, 


Rees Ti VOoy (6.270) 


ee ee: 
cats : (6.28) 


These unstable disturbances will first appear with a 


characteristic wavelength 


pee pede aoe Ge (6.29) 
(e, ae 


For other boundary conditions the critical Rayleigh 


number is different (e.g., for rigid boundaries, R, ¥& W038). 


Thus, in @ given @xperniment, the valuelor fais 
set by fixing the value of 8, the temperature gradient, and 
POL he Re PERS VSEeM 1S °S tab Cs. Other. Ros the system is 
unstable and spontaneously starts to convect in a cell 


pattern with cell size determined by the value of d. 
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These results have been verified within the limits 
Ghyjexperimental accuracy. As an example, for rigid boundaries, 
the experimental value of Re is 1700 + 51, in good agreement 
with the theoretical value. 

The above theory of the Bénard instability has the 
Simple interpretation that the instability occurs at the 
minimum temperature gradient at which a balance can steadily 
be maintained between the kinetic energy dissipated by 
viscosity and the internal energy released by tne bouyant 


force (icf. (Chandrasekhar [21 ]). 


Sec stability Criterion of Glansdorff and Prigogine 
net and Prigogine [1] have analysed the 
Bénard problem in terms of Liapounoff functions rather than 
normal modes. The stability criterion which they derive is 
a sufficient condition and hence is less precise than the 
exact solution by normal mode analysis. Their approach will 
bewbrierty outlined. ,in the ispirit of section, 4. ly) thegmo- 
aynaiic stabulity, 1s necésSary in the Sense wthatventropy 
HiuctUctLONS must regress. IhiSecan De vex pressed acmine 


requirement that 


Maeroecs! oe (6.30) 


ot 


where ef is some positive definite weighting function 
However, this criterion does not apply to systems in which 


there are convective motions. In this case, velocity 
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fluctuations must also regress. This requirement can be 
written as 


0 Spat in be 


wnere Ov is the difference between the fluctuating and 
steady state velocities and ne 1s another weighting function. 


Using the balance equations, these criteria can be written as 


d 
(eB arent (veg s 8 peay Sans o (6232) 
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where < > denotes averaging over the horizontal plane. 

The first is a purely thermodynamic criterion, 
while the second is a hydrodynamic stability criterion analo- 
gous to the stability criterion in normal mode analysis. 

Each of these criteria separately yields a critical Rayleigh 
number and it is the smaller of the two which gives the 
Hesaredistabinity ‘criterion since Doth) (6.32) and (6.33) 
must be satisfied for the system to be stable. Note that 
these criteria are more severe than the normal mode criterion 
Since’ they require that each decay’ be monotonic. Also, note 
that, at the instability determined by» the normal mode” method, 
the fluctuations themselves diverge, so (ees and (ony > must 
also diverges’ Ihus, 1f the’ critical” Rayleigh number= for tne 
NM 


normal mode approach is denoted by R. , and those’ for the 


entropy and velocity regression criteria (eqns. (6.30) 
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and (6.31)) are denoted by Re and Re respectively, then both 


NM 


R> and Re are Jess than or equal to Ro : 


C 


NM 
R. 


They will equal 
1iptherevare no oscillatory solutions of the’perturbation 
equations since then the normal mode criterion implies that 
all disturbances decay monotonically. This means 
a(s's) > 0 and ats)" < 0 and the separate criteria are 
equivalent. 

Glansdorff and Prigogine combine the two separate 
Pacer ias\6.30) and (6.31) into one by ‘choosing asa 
Liapounoff function 


ré = om) EE os (6.34) 


where Le and ie are arbitrary positive weighting functions 
with aac = se" —"Qiay SIS? Stability crvcerton as Less 
restrictive than the two taken separately. This is most 


easily seen by considering a path in ae 65 , ai 


me Space 
which is stable with respect to the criterion 


2 


oe < 0 (6.35) 


but not with respect to the combination of (6.30) and (6.31), 
Seal estrased im erigs.°6.Ja,, 61D, and 6.-7.c eu wines s.ame 
evolution is illustrated in all three graphs. It is obvious 
miomer asso. la that thase-path Sdtisties eqn. (6.35) and so 
that the system the graph refers to is stable by that 
criterion, and it is equally obvious from Fig. 6.1c that 


criterion (6.31) is violated. Thus, a system may evolve in 
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A possible evolution and its stability 
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such a manner as to be stable with respect to eqn. (6.35) 
muermouwiitimare speictratouboth of eqnsiey(GS30imand (6.31): 
However. although eqn. (6:35) asa tess@restrictive 
eriterion, 1¢ 1S still not as general as the normal mode 
analysis since the criterion (6.35) still excludes some 
Oscillatory approaches .to steady state. This means that. if 
mre marginal stability problem is solved for criterion (6.35), 


a critical Rayleigh number Re will be found which is larger 


than the lesser of Re and si but smaller than Rone Note 
pat for ge =e 

Re = Re 
and for 1° = 0, 

ee (6.36) 


Therefore, in order to get the best (largest) value of Be 


for witch the system 1s still’ stable (not just monotonically 
Stable), Re should be maximized with respect to e* and ce. 

However, it "1s notea that again, i @ case winere gtire return 
momsteadysstate ts monotonic, dil three criteria are equiva: 


lent and 


NM _ 


he Ss V 
_ Re = min(Rs R-) : (GMS 7a) 
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In the Bénard problem, it can be proven that there 
are no oscillatory approaches to the steady state for posi- 


Hive Rayleigh numbers (oc .is real). Therefore, in (the 


eritenion 106235). ef and x? may be chosen in any manner, .and 
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the result will be the same, namely Re ow Less ewira t 


Glansdorff and Prigogine [1] do. They choose 


and 1° = af 
Cans 
aeeasy 
where ios ae é Gores 6) 


It should be noted that this choice is merely one of conven- 
jence and will not affect the resulting value of Re because 
of the monotonic nature of the decays. However, it is true 


at aun practice, Re is often found by a variational method, 


WSING Ss OMe rtri al sunctionsp. The value lof Re fOVMaR partie bar 


trial function will depend upon = and ve However, for a 
completely arbitrary trial function (satisfying boundary 


GondneLonsi,.ctce)., the extremum of Re (v, ee 7S) 


must be 
independent of 4 and ae The issue is slightly confused by 
the fact.that.the -actual,-variational .procedure is over the 
non-trivial, unstable trial functions yielding Re as a 
minimum. That is) RP is found as the smallest value of R for 
which an undamped solution to the perturbation equation can 
SX Site 

However, the arguments above are easily modified. 
For example, in finding tes the minimizing procedure is over 


NM 


a larger function space than in finding Ro Since some 


functions which are stable in the normal mode approach (hence 


excluded from the trial function space) are still unstable in 
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the approach of Glansdorff and Prigogine. Therefore 


NM 


C 
Ro < Ro 


as’ before. 

The above comments on the relative values of Re 

Ro Re, and Re obviously apply only to the true values, 

and not to the approximate values which may be found by a 
specific, simple trial function. For example, Glansdorff 

and Prigogine (el GRID AF ON? SP iid aa vv alive tof Re of approximately 
672 for free boundaries which is higher than the exact value of 


about 657.5, although it is known that tne true minimum 


NM 


‘ (actually it 


value of Re must be less than or equal to R 
is Sau to Re 

The fact that all perturbations decay monotonically 
is the reason that the method of Glansdorff and Prigogine [1] 
agrees so well with the normal mode method. They are, for 
the Bénard problem, equivalent. The accuracy of their method 
with a relatively simple trial function may be largely due to 
a judicious choice of weighting functions but the "exact" 


result (for a general trial function) must be independent of 


en Se CHO lL Ce:. 


§6.3 Nature of the Unstable Motion 

This theory, although in good agreement with 
experimental results, is incomplete, even in the range where 
the approximations are valid, since it does not give a 
complete description of the instability. The instability 


is characterized by a typical length ho but nothing is said 
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about the actual shape of the convective cells. For example, 
there are an infinite number of rectangular shapes all having 
the same value of hee but with different ratios of side 
lengths. However, from the symmetry of the system, it might 
be reasonable to assume that the cells must be regular 
polygons and that they should tesselate the plane. Thus, the 
cells should be regular triangles, squares, or hexagons. For 
Geacheceli pattern, it is then possible to deduce the motion 
of the fluid in each cell. For example, with regular hexagons, 
the liquid rises in the center, then flows outward at the 

aR Surface and down at the sides. 

Actually, it has recently been found possible to 
predict the structure quite completely in the non-linear 
regime slightly above the critical Rayleigh number. A 
number of transitions with different patterns are observed, 
making the problem rather more complicated tnan in the 
simple analysis above. For a review of experimental and 
theoretical results, see the article by Whitehead [22]. 

Experimentally, it is observed in a typical case, 
that immediately after the onset of “instability. there vis <a 
period of short duration when the cells are moderately regular 
and are convex polygons of four to seven sides. Eventually, 
the cells become stable, regular hexagons, properly aligned. 
In these hexagons, as predicted, the fluid rises in the 


centers and flows downward at the boundaries between 


aciacent cells. 
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CHAPTER vid 
STABLE RTY 10F sFLUIDS IN MOTION (TURBULENCE } 


§7.1 Nature of Turbulent Flows 

A final example of a macroscopic system far from 
equilibrium is supplied by a real (viscous) fluid which is 
in motion. Even in the simple case where thermal and chemi- 
Gal transports are negligible, the motion of a fluid has 
many interesting and poorly understood features. The 
additionally simplified case of an incompressible fluid is 
almost always considered since tne equations of motion are 
extremely complex Meo Chis aSSunpaon ands tets. No tesa 
bad approximation to many real liquids under moderate 
conditions. 

Areal fldid displays a transition from stabie, 
reduian-.slamimner flow ito. chaotic, Turbulent. flow for 
SULpicientl van Ont ludd, Velocities.) Solaicen cr iatitnesor 
Eniss instability and the-properties of the sturbulent=f laid 
which Will be considered. the properiiessonsparticular a= 
minar floWS are not general, since the prectse fluid flow is 
determined by the individual boundary conditions. Thus, it 
is not possible to make any general Statistical predictions 
of the fluid properties and each system must be analysed 
separately. The turbulent flow, however, is essentially 


random in nature and it would be hoped that the properties 
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of the fluid could be statistically predicted. In order to 
actually, do wthis,, some rather. drastic simplifications, must 
Be Made but-Sitil leit, may, be possible to gain some wansight 
aco, the, nature of. real turbulent. fluids. 

Before proceeding, just. what. is) meant by "turbulent 
Flow" will be clarified. Considering a liquid flowing 
enyough: a pipe. for. i) lustration, then it is known: that .at 
PWeveLocic ies thes lOW-iS. laminar. What iss. a. stud 
element follows a smooth trajectory and an element which was 
Poorman it Wisi) a OlnOW a similar trajectory... Thus. othe fluid 
ae "streamlines" of flow which preserve their joint distri- 
bution at large distances and long times. This can be 
differently described by saying that the fluid velocities 
are strongly correlated at widely separated times. It is 
also a feature of such laminar flow that the fluid motion 
can be completely determined from a knowledge of initial and 
boundary conditions. 

If the other parameters of the system are held 
eonstant wand the fluid velocity, issincreased., tis sound 
piatesat an certal ncn tical welocityyethemacureror the 
motion changes completely. Above the critical velocity, the 
fotionulsecharacterized by. strong, agitation saihesstrneamlines 
are chaotically interwoven and rapidly changing. In the 
Euler coordinate system, this is seen as large and apparently 
random fluctuations of the fluid velocity field. In the 


Lagrange system, turbulence results in the rapid mixing of a 
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fluid element with its surroundings. An important feature of 
turbulent motion isifits random nature. It is not possible 
to determine the fluid motion from a knowledge of the initial 
and boundary conditions alone. It may only be possible to 
determine the statistical properties of fluid turbulence. In 
Somtrest to laminar flow, fluid velocity correlations die 
out rapidly for large times, although for short times the 
requirement of continuity results in large correlations. 

The existence of an instability in laminar flow is 
a direct result of the non-linearity of the equation of 
motion. The fluid, which is assumed to be incompressible, 


obeys the Navier-Stokes equation 
ON EP As Vy SS a Vp + yV°V (7215) 
along with the condition for incompressibility 

SPD Ea) Oo CED) 


Bone (J oh PSsStil) quite complicated. However, 1t is 
possible to understand some features of turbulence without 
Creating “tt ‘explreretly. 

As Stong “ago ‘as "18e3, Reynolds» realized that a 
qualitative understanding of the onset of turbulence is 
possible through simple analysis of the dominant forces. 
Ine fritid’ «these ‘are the “dissipative viscous force nee and 


the inertial force ae which arises from velocity gradients. 
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The inertial force is of the form 
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nunene {D ibs; @ length softhe order of the size of the system. 


ine VISCOUS HTORGe hSsOtethe form 


Foe | w ni[vev = ala . (7.4) 


vis 
Mapchiene tex ¥s ts cansinitial Laminanaflow<andeit dis us bight ly 
perturbed, the flow will regress to the initial flow if the 
MNNGOUS efOrce nks alanger than the -imertial force. That is, 
the flow is characterized by a dimensionless Reynolds number 
bessucieathat -nhftRe-<)1 the flow is,rbaminane « Heres «Re sis 


defined by 
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Mmretactus Tt 1s found that ne "can be larger-than one®and sti tl 
allow laminar flow. Instead, there is a critical Reynolds 
number Re | SUCH clat.aror one < Re o> the viscous force damps 
mice roca tmiirctiations and, for “Re Reo» the local fluctua- 
tion is carried away into the fluid as turbulence. 

Afsio PWexperimentally tis necessary’ vo ‘drstimauish 
between two cases. For the transition from laminar to 
tTurDurent “flow. tt is found that there 1s no™“absolute ‘upper 
limit on Re. Laminar flow has been maintained in circular 


pipes for Reynolds numbers as high as BOL0005 althougit tinis 
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flow is highly unstable. For the change from turbulent to 
laminar flow, it is found that the transition occurs for 
Re &% 1100 (again in circular pipes) regardless of how the - 
transition is approached. 

Ine ents “analysis, tt 1s also clear how the w@andom 
nature of turbulence arises. For Re > Re o> Chesmrerosco PC 
fluctuations, which are always present in a fluid, grow 
rapidly to finite size. The motion thus depends not only 
upon the macroscopic initial and boundary conditions, but also 
upon the random microscopic fluctuations. 

| Another point of view with regard to turbulence is 
possible by considering velocity correlations. This approach 
was developed between 1920 and 1941, particularly by Taylor, 
Richardson, and Kolmogorov. Since velocities in a turbulent 
fluid are correlated at short times and distances,. but not 
at large times and distances, there is inherent in a turbu- 
Hent fluid a Jength scale which 1S an “average correlation 
fence weoteaneentirely different Scalem tron the Siz7ee0f stne 
system as a whole. Thus, turbulence can be viewed as the 
simultaneous existence of macroscopic, cooperative regions 
characterized by a different order of deviations from the 
average velocity than the fluid as a whole. These regions 
are called eddies and have a typical jsize , and a typical 
velocity v. . Within the eddies, the velocities are strongly 


correlated and, outside the eddies, weakly or not at all. 
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In a real fluid, the eddies are expected to interact with 
each other and with their surroundings, resulting in the 
eeeation, destruction, and transformation of eddies as 


time progresses. 


Sica ANalyticedDescription of Turbulence 

In this section, for convenience, vectors and tensors 
will be indicated by indices and summation over repeated 
indices will be assumed. 

The idea of a Reynolds number which determines the 
nature of the flow can be generalized with the eddy descrip- 


tion of turbulence. The fluid velocity can be separated into 


an average velocity v, and a fluctuating velocity Vi eed Neue 
is 
Werte N Mata (76) 
where Vv; =)0 The enerdy of the fluctuations is: then 
piss 12 ptvegy 4 am 


The quantity which determines whether a given flow is 


turbulent is oo . This can be separated into an inertial 


and a viscous “term as 


des. weds dE: 78 
dt ~ dt | * at | (7.8) 
in vis 
Then, if oE <60, ‘there is’ baminar flow, andeit 


jal 
m™m 


> 0, there is turbulent flow. Consider now a localized 
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Weroc?’ty*riuctuation or eddy “of ‘size=x "and ‘wrth fluctuating 
velocity Vy 4 . The kinetic energy associated with the eddy 
is 


; (7.9) 


fue 
E ala 
and a typical time for the eddy to appear is 


# taekeres| (7.10) 


The energy transformed per unit time to the eddy from the 


mean motion is 


(Peet 18) 


eomengt ke “yas Gag) (7.12) 


if the velocity gradients in an eddy are assumed to be of 


order (4) Me eins, tie condition tor san eddy to exicitens 
AV. 
aot. BRO ae eee (7.13) 
v r 


The quantity Re, is called the internal or spectral Reynolds 
number. Therefore, there is a minimum size of eddy that can 
Gxicst. theesize of which is denoted Dy Roe Since tne eddies 
are limited by the size of the system, tne largest eddy has 


~~ D. The eddies with the largest Reynolds numbers will be 
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most favourably created and will appear first as turbulence 
pegins. = When the fluid velocity is slightly larger than the 
critical velocity, the turbulence will be dominated by eddies 
Or sizenD. Smaller eddies may be created, but will soon 
eriuler die outsor grow Into larger ones. “If the mean fiuid 
velocity becomes larger, the velocities in the large eddies 
are large enough to allow the creation of smaller secondary 
eddies. This results in a spectrum of eddies which might 
mEypacalpy look like Fig. 7.11. 

In ithe Wangest eddies # the effectmot viscosity is 
unimportant and energy is lost only through transfer to 
Smaller eddies. This is balanced by the flux of energy into 
these eddies from the mean motion. 

As A’ gets smaller, the effect of viscosity becomes 
more important until, at some size ho? the energy is dissipa- 
Eedeby mriculonaw forces as oquiuck ly asmit wis, received irom 
the larger eddies. The size Me provides an internal length 
Scale which. in atmospheric turbulence, for example, might 
be about one centimeter, while D might be around a kilometer. 

The main problem of turbulence is then to determine 
the eddy spectrum from the equations of motion. Some of the 
main approaches to this problem will now be presented. 

Binsit, the velocity correlation tensor ea is 


defined as 


(X,tshot) 2 vi(kst)vi Ger, tte) (7.14) 
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where the bar denotes an average. This then is the average 
correlation between the fluctuating velocities at two differ- 
ent points in space-time separated by r and t. This tensor 
is also known as the turbulent energy tensor. Its importance 
is seen in considering the equation of motion for Va. Using 


eqn. (7.1) and averaging (with v, = v. + vi, p =p + p', 


MeN =p. = 20) yields 
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These are the Reynolds equations for the mean motion. They 
consist of four equations in ten unknowns and hence equations 
are needed for the terms Viv 

If the simplified case where v; = 0 is considered 
(as could be realized experimentally by stirring a fluid 
violently and then watching the turbulence decay), then the 
equations for the velocity correlations may be written as 
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ik,i? 
Since the fluid is homogeneous and isotropic, the 


tensor Bij can be written in terms of two scalar functions 


of r(= |r|) 


> fi he é 
Bij (rst) = i [B, (r,t) eans cietGe lee + Bante tos 4 


(726°) 


where Boe and Es are scalar functions corresponding to the 


projections of B, (rt) along the vector yr and normal to r 
respectively (no summations over 2 or n are implied). 
For’a'proof of this, see Panchev [23], pp. 89-93. 


Also, for incompressible fluids, 
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The function By (r,t) allows one to define a 


characteristic longitudinal correlation length Ly as 


L, = J Bp y(r,t)dr : C7231) 


Similarly, it can be shown that the third order 
correlation Bk ; can be expressed in terms of a single 


scalar function Boyg(rst), the longitudinal correlation 


wunction of ‘third order. 
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Posercingrinesegexpressi ons .in_(7. 30) gives 


(r 2 + 3)(% - a s— (rv) 2-))B, (rt) - 
($+ =a (rath) =o. en 


If the expression in the brackets is to be non-singular at 


¥-0, then 
25 EGE . ~o_ 4a 
iy: Re Broa pl Poe (aoe) - ne ar Boog (rst) : (FSD) 


This is known as the dynamic equation of Karman- 
Howarth. It is an exact equation governing the decay of 
turbulent correlations in an isotropic, homogeneous, and 
incompressible fluid. In order to solve for Byy(rst) and 


wius fOr B, (rt), B (r,t) must be known. If an equation 
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fori B retpeistderived, i tiwi 1 1einvolverfourth order 


oan’ 
corre lationssand?so on. oThuss in order®to’ get avsolution 
for the second order correlations, it is necessary to make 
Some assumption about the higher order correlations. 
Porsexample, ih the finales tagesof decay. 1 t- might 


be assumed that all triple correlations have disappeared 


(Bo ,,=0) so eqn. (7.38) becomes 


0B 2 
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or. 
This equation has a solution of the form 
-r?/8vt 
- (7.40) 
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near r=0 (i.e. for small eddies). With r=0, the law for 


decay of turbulent kinetic energy is deduced as 


Chetan josey vena. (7.41) 


mieune final stages of decay. ‘lt is also possible to find 


the time dependence of the correlation length at this stage. 
ei cal ks 1/2 
L(t) = fe Cran : Cima) 
0) 


Thus, the Reynolds number has the dependence 


Re = ieee Lae (7.43) 
am the final stage of decay. 

These power laws have been verified to within the 
limits of experimental accuracy (cf. Panchev [23]). This 
gives at least some support to the concepts of homogeneity 
and isotropy in neal fluids: as wel. as papkiaily veninyinag 
the applicability of the Navier-Stokes equation to turbulent 
Fluids. 

Rather than dealing directly with the velocity 
correlations, it is often easier to apply physical intuition 
in dealing with the Fourier transforms of the correlation 
functions. This is the basis of the spectral approach to 


turbulence. 


First, define 6, ;(k>t) as the Fourier transform 
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iien..from the, tensor, function. 6. (kt), a scalar function 


ij 
o(k,t) can be defined as the kinetic energy in a Spherical 


Shell between k and k + dk 


b(kat)dk = 5 0,,(K,t) x 4nk*dk 
where k = [kK | and homogeneity and isotropy have been assumed. 
Then, 
ee, oe. 
a V(t) = f o(kst)dk (7.46) 
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and Pim, is the Fourier transform of im.3 


By taking the trace of eqn. (7.47) the equation for 


puke t is, found.as 
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oe = W - 2vk? 9 (7.51) 


then W may be identified as the rate of energy transfer from 
the large to the small eddies, and the term ~2vk*6 as the 
rate of, viscous dissipation of energy in eddies of wave 
number k. It is easily seen that the transfer of energy 
between different sizes of eddies depends only upon the third 
order correlations. 


It is possible to show that 


Woks t) “dk t= 30 Gi252)) 


oOo; 8 


which means that the interaction between eddies does not 
affect the total viscous energy dissipation. 
in. the’ final stage of decay, W e320) since, the ithind 


Order correlations disappear. Then, 


-2v ar 
gi Kt) = io (KO) Cua Gis) 
which again shows that the eddies with the largest k 
(smallest size) are most quickly damped by viscosity. 
The basic problem then could be stated as finding 
the functional dependence of the energy transfer W upon the 
Spectrum ¢ . Once this is known, it is possible to solve for 


¢ and essentially everything about the turbulence is Known. 
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The general nature of the spectrum and the ane ey 
eranster and 105s 1s Summarized in Fig. 7.2. 

In; the range k < Ko the eddies are produced from 
the mean motion of the fluid. For Ko 7 Reais the main 
mechanism is transfer of energy from large to small eddies. 
Mis isjreferred to as. the inertial range. For k > Ko? 
viscous forces dominate. 

The functional form of o(k,t) can be determined for 
Ko ae Kee KG by dimensional, anafysis. In this region, wiscous 
dissipation and eddy creation from tne mean motion are negligi- 
ble. Thus, the statistical nature of the turbulence is 
determined by a constant parameter e€ which determines the 
energy transfer from large to small eddies. Hence, $¢ is a 


minetion Only of ge and k . If a power law-of\the form 


o(k,t) = a eP ka LAA 


is assumed, then, since the dimensions of 9 are (length)° 
(time)”*, Peers —found—tirat-p-="2/S-arid—qr—"'5/S ir 1snieans 


that 
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In order to gain some insight into tne dependence 
of W upon #, integrate the equation of motion (7.51) from 


zero to k, giving 
k 


k k 
oo (Paipetidp = ( W(p.t)dp -20 4 (pst) p 
O O (@) 


dp. (7256) 


j Ce? * | apasn sid" 
fyF% act to ‘mii 6 
yo yet edert pe Ne 


" 


Ph eioede Cua Aca? bai) ‘i 
S297 b Ce | Bite pi ene ts ar ork , | 
a - 104" " etsy) ‘tel bv 
| | Bnd 4 ed “as snimob ona 


vi anottont! 


vot bhenftuysteore 
. . ba ae 

is 

evoger¥ ), MOT osm aus aT fotiotenstit’ iis es 
/ a 

ae, 


-fp ti psn, avs nc, OH ASS on ? ae » bbs Sa 


ed | gone tudnud ne 


Ry. 


wd 


ond aati wl 18d a no 


“et ar setae 

A tine ¥9 ae 
‘aa ae ee NP | ig , ae heer avers F 
Pee (hia): ede i a 


, a.) in 
i ; s 1) Op eee iy. r 
pai . ee he 7 & 


Y i 


anes Ge | yoni 26 004 


mis, vba fo Wo}! 


Ei atonal B15, 8 Fo cao renliy ene andi 


engi ert? jExa = p 


Palig:, 


VERT 


t} 


———} : 


| 


— eee ee ee ee LO A Se eS ee SD ee ee ces See ee er oe ee ee 


Turbulent spectrum and 


eddy production from 


energy transfer from 


( 


ne 


energy transfer 


mean motion 


large to small eddies 


VISCOUS dissipation of kinetic energy 


seanvd yoaane) Binal wing qe dnetueuT 


: ’ hi _ Ve + r 
: 1 i a i 5 a ie i . 
} a a \ i 7 ee 
iF nih a a 
Ma : it Le “eee : , 
, : A. i 


oe err! 2) Pt 


4, pale ae ‘i 
Aalilt pe | r a 

| hy " ‘ | Ri ie f 

’ ‘a it , ni ; wh ; a ly 
aor hom kein, man of 


i 
th) 
; 


F - ' . 
MME ai ih oa fat 


anh vy 


: 


f 


Since most of the kinetic energy is in the small 


eddies for which p Ky? 


k fore) 
{ o(p.t)dp y f o(p,t)dp (7:57) 
@) O 


k 00 
3 3 = 
THUS , 
: 2 
eRe rie jytricy { aipptlip> dp (7.59) 
0 
k ie 
where F(k) = - f W(p,t)dp = ! W(p,t)dp ; (7.60) 
0 


Here, F(k) is an energy flux function which describes the 
transfer of energy from large to small eddies. 

In order to extract further information about the 
turbulent motion, it is necessary to assume a specific 
formator Fik). This means that an assumption about the 
dominant mechanism of energy transfer must be made. Many 
such assumptions have been made (cf. Panchev [23], pp. 198- 


Pao yee Here, only one will be described - the ansatz of 


Heisenberg. 


For viscous dissipation in the smallest eddies, tm 


can be shown that the rate of dissipation, €, iS given by 
Sh | Sages 
en Jaeger, (FG) 


and 
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for large k. Heisenberg assumed that the process of transfer 
om energy from large to small eddies is similar to the pro- 
eessOr VISCOUS dissipation in’ small eddies. That is4she 


assumed 


K 
F(k) = vq(k) f 2o(p) p® dp (7.63) 
0 


where v7 lk) icseean Weescosity'’ > coefficient describing the 
damping of large eddies due to the motion of small eddies. 


Thus, the spectral equation becomes 


k 2 
eat vr(k) J f2¢00 aap 
0 


dpbt (7.64) 


In order to find a plausible form of vrlk) » assume that it 


depends upon 9 and k: 
vr(k) = vzlo>k] (7G) 


where Vr Has “Untys “of (length)¢ + (time). Since the damping 
of large eddies should depend on the presence of any smaller 
eddies, it is expected that vz (k) 1S) as SHUN tao acute wan lele eee 


From dimensional arguments, 


valk) = ¥y y Mcialasg eek (7.66) 
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which is Heisenberg's original expression for Vie For 
S ae 
kK 2 € 
2 J o(p) p° dp x = (7.67) 
fe) 
SO.7as. kK 2) ©, 
‘Ss, 
0 ae vr(k) = (7268) 
Therefore, 
Gave) 
2 € uf 
kK o(k) eed | (7269) 
Vv 
Substituting expression (7.66) for Vr gives 
2 = 
1 vk j 
NUS) a? ames eer (7.70) 


Vv 


Su 1K “> co 

Unfortunately, the Heisenberg ansatz atierevte from 
Serious drawbacks. First, although the idea of small eddies 
acting as an effective viscosity for large ones seems plausible, 
there is no reason to suppose that this is a good description of 
mie interaction between eddies of nearly the same "size. Also, 
the dependence Vr = v7 L¢,k] is not consistent with the 
physical requirement that the small eddies be statistically 
independent of the large ones. 

The Heisenberg expression for W(k) agrees only 
qualitatively with experimental results, and there are some 


features which are not experimentally observed Genie tevey cen! 
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[24]). Although part of the difficulty may be in obtaining 
the necessary isotropy and homogeneity in a real fluid, it 
would seem that energy transfer is a complex phenomena, 

unlikely to be accurately described by such a simple ansatz 


as that of Heisenberg. 
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PART sid 
CAPER VLE] 
INTRODUCTION AND FOUNDATIONS 


foie is tomice |) Introduction 

Although macroscopic thermodynamics was a well 
Setablisned branch, of physics by the middle of the 
nineteenth century, there were many aspects of thermo- 
dynamics which were essentially phenomenological. For 
example, thermodynamics was incapable of quantitatively 
Gescribing the behavior .of a specific material. for 
example, the equation of state of a given material was 
not a theoretical deduction from thermodynamics but 
rather was an experimental addition to the theory. This 
deficiency was, of course, remedied with the establishment 
Oreedui Librium statistical mechanics. A similianesituation 
existed in non-equilibrium thermodynamics where the 
coefficients relating the thermodynamic forces and fluxes 
had to be taken from outside the theory. 

In order to develop a theory which could yield 
both equations of state and transport coefficients it was 
necessary to know what determined the macroscopic 
properties of different materials. The essential 
development which permitted such a general theory was 


the acceptance of the atomic theory of matter. This 
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theory, which was based largely upon the study of simple 
chemical reactions in gases, resulted in the point of view 
that the macroscopic properties of a material depend only 
upon the properties of the identical atoms that comprise 
the material. 

Although the atomic theory itself was controver- 
Sial throughout the second half of the nineteenth century, 
it had a number of important applications in the kinetic 
theory of gases during this period. 

This microscopic theory resulted in the 
derivation of equations of state and transport properties 
of dilute gases. As well as these practical results, 
such theories of gases had more profound effects. The 
kinetic theories of Maxwell, Boltzmann, and others gave a 
microscopic, mechanical interpretation of such established 
thermodynamic concepts as temperature, pressure, and 
ehemical.potential.. In,so doing,, they, pointed .the way to 
generalizations and further applications. Also, from the 
beginning, kinetic theories introduced the concept of 
probability. At first, probability was introduced as an 
assumption that all the molecules moved independently or 
in only one direction or something similarly simple, and 
was seen as an undesirable aspect of the theory necessary 
only because of the complexity of the dynamical equations. 
Later, the probability aspect became both more sophisticated 


and more firmly entrenched as it was realized that the 
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extremely large number of molecules in a macroscopic 
System made the dynamical solution impossible and the 
Statistical solution more precise. 

Despitesthe successes of the kinetic theory, 
there was considerable resistance to the statistical 
theory throughout the latter part of the nineteenth 
century. This was in large part due to a feeling that 
probability concepts were foreign to a previously 
deterministic physics and must eventually be supplanted 
Gray, exact, .and -corgect" theory. 

However, as the evidence for the atomic nature 
of matter mounted, it became more obvious that statistical 
concepts were not just temporarily necessary and were not 
bimited-ineapplicability to dilute gases. One of the most 
compelling arguments for both the atomic theory of matter 
and On ,the app licabihity of .stabistics sto systems, other 
than dilute gases was the remarkable success of the 
statistical theory of Brownian motion. Brownian motion, 
which provides almost direct evidence of the existence of 
molecules, was analysed using statistical methods by 
Einstein and by von Smoluchowski in the first few years of 
the twentieth century. In addition to this evidence of the 
usefulness of statistical methods, the acceptance of these 
concepts was probably accelerated by the publication by 
Gibbs, in 1902, of an elegant and precise formulation of 


Sretistical physics. In his treatise, Gibbs introduced 
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the concept of ensembles of identical systems and, in so 
doing, separated the concept of probability from the 
geverministi¢c dyndiics of a system. 

The combination of the above factors resulted, 
pyethesendsoncther first decade of this century, in the 
general acceptance of statistical physics as a major 
branch of theoretical physics. The many successes of tne 
theory have since justified this acceptance. In addition, 
statistical physics easily made the transition from classi- 
cal to quantum mechanics. 

With these historical comments, this chapter 
will attempt to examine some of the fundamental concepts 
Orestatistical physiticss 4 (After /nhaving, introduced the main 
concepts, further chapters will give more detailed 
apoiieations#or itherstatistical method ‘toi both iclassicat 
and quantum non-equilibrium systems. The emphasis, however, 
will be on general formalisms and examples illustrating 
general principles rather than upon detailed calculations 
for special *systemss Also, no attempt will be made to 
exhaustively cover the huge range of non-equilibrium 


Situations. 


o0.2 Classical Foundations 

Classically, there are two reasons for introducing 
probability concepts into the physics of systems with a 
large number of degrees of freedom. The first is .the 


practical consideration that it is impossible to actually 
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solve the exact dynamical equations for complex systems. 
Thus, it is hoped that, by ignoring the details of the 
actual motion, simpler equations may be obtained for the 
evolution of averaged quantities. However, this alone is 
peoredaesatystactory “justification for imtroducing 
probability concepts since there is no intuitive reason 
why it should always be possible to describe a nearly 
arbitrary motion in terms of a few statistical parameters. 
On the other hand, even if it were possible to exactly 
solve Hamilton's equations, thus eliminating the above 
Reason “frorrintroducing probabilities, the resultant 
evolutions would still depend on the initial conditions. 
mien, Since *ip@is*rmpossiblée >; from®a practi cal=pome=or 
view, to measure simultaneously the initial position and 
momentum of each particle, the initial condition must be 
Heecrtped as arstatistical distribution, “rather than™a 
eimore deterministic quantity. “This *potnt™of vrew'Ts 
even more reasonable when non-isolated systems are 
considered since the thermal interaction with the 
surroundings will act to randomize the motion of the 
Systeme Nth thts pointe of view, there™1s ne conceptual 
difficulty in introducing probabilistic ideas since they 
arise from an initial lack of knowledge about the system 
and, once introduced, the statistical distribution evolves 


in a deterministic way governed by Hamilton's equations. 
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In quantum mechanics, this uncertainty in initial conditions 
enters due to the, practical impossibility of determining 
a complete set of eigenvalues. 

Of course, no matter how the probabilities are 
Imenoduced.ssiheresis still the practical difficulty, of 
E-terminingeor guessing, the :distribution itself. .This 
often takes the form of an assumption of equal a priori 
probabilities or something similarly simple. 

Ltvismctue mint Godlchion of, probabilisei canna | 
conditions that corresponds to the representative 
epoembles of .Gibbs«. 1% a large number of identical 
replicas of the system are considered (e.g. identical 
with respect to such measureable macroscopic parameters 
as energy or momentum), then this collection of systems is 
Said to form a representative ensembie. As the number of 
Scesa0 f@etiewsystem tends to. infinaty, the memberseot stie 
ensemble (considered at t = 0) will distribute themselves 
according to the probability distribition 0(X,,Xy,.-.sXy> 


t=0) over the microscopic initial conditions on 


Pe => 
Goakoenys>ky) Here the coordinate Xs represents the 
three position and three momentum coordinates of the 
6> Seer 
jth particle and Ca dare saN abe d X +++ Xn is the 


probability of finding the system initially in the volume 
A ed x, of the 6N dimensional I-space of the system. 
To actually follow the time eVolutioneot po corpesponds, £0 
exactly solving Hamilton's equations for all possible 


i7bebal conditions. 
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BAS realized that; in practice..a warei cular 
member of the ensemble is chosen and its time development 
followed. The process of measuring some dynamical para- 
meter corresponds to taking an average of that parameter 
Byer dad finite time t., It is obviously desirable to 
determine the conditions under which this finite time 
average is equal to the average over the ensemble. Most 
of the effort in this area has been directed toward 
equilibrium situations and this special case is reasonably 
well understood. Proofs of the equality of time and 
ensemble averages involve what is known as the ergodic 
theorem. Since the main interest in this thesis in in 
non-equilibrium situations, only the basic results of 
ergodic theory will be mentioned (cf. Isihara [25]). 

Since, in equilibrium, the relevant macroscopic 
parameters are time independent, the averages over a 
finite time t may be replaced by averages over an 
infinite time. it can be proven that, for almost any 
maitial conditions, the limit (1 + @) of the time averaged 
parameters exists, provided that the phase space is 
metrically indecomposable and also that, under this 
condition, the time average is equal to the average 
Over the initial ensemble. Metric indecomposability means 
that the phase space cannot be split into two invariant 


parts of finite measure such that a motion starting in one 
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part remains in that part forever. Under the assumption 

of metric indecomposability, any trajectory, whatever its 
Homo le conditdons:: willl pass arbitrarily close to any 
pomnic! oinarthiey sumPaice rf constant energy (called the 

ergodic surface) given sufficient time. This means that the 
avemager ofxias tuncttom over the entire trajectory (infinite 
time average) is the same as the average over an ensemble 

in which the member systems are distributed uniformly 

over the ergodic surface. 

Thus, the problem of justifying representative 
ensembles in equilibrium statistical mechanics involves 
the assumptions that actual measurements correspond to 
infinite time averages and that the phase space for the 
system is metrically indecomposable. The first is 
plausible for equilibrium systems, provided the time 
Scale for measurements is much larger than that for 
fluctuations. The second is a rather abstract mathemati- 
cal concept which requires investigation for Damelcu lar 
Sysients!a | Sufieice toi say thatthe phase space of certain 
simple physical systems, such as a gas of hard spheres in 
a box, has been shown to be metrically indecomposable. 

Since proofs of the equivalence of time and 
ensemble averages depend critically upon the averages 
being over infinite times, the theory does not apply to 
non-equilibrium situations. It is precisely the informa- 


tion on time-development which is of interest in most 
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non-equilibrium situations and this information is lost 
inneveraging,over.all,times.,,It may be thats in Systems 
where a microscopic relaxation time exists which is 
sufficiently small compared to the macroscopic evolution 
time of the system, an analogue to the equilibrium ergodic 
theorem exists. This theorem should indicate the 
conditions under which finite time averages would be 
approximately equivalent to averages over an ensemble. 
However, such a theorem would require some use of the 
dynamics of the particular system in order to determine 
the relaxation and evolution times. Due to these basic 
difficulties, the usual approach in non-equilibrium 
Statisticalaphysics;is.not.viaian ergodic,theorems 
Instead, it is usual to treat the time develop- 
ment of an arbitrary initial distribution and to simply 
assume that averages over the ensemble at a particular 
instant are equivalent to physical measurements on a 
Ganghetsystem atithat,instantetr,@he dustificatgonsofptais 
essentially rests on the observation that, for most 
physical systems, repeating a non-equilibrium experiment 
starting with the same macroscopic initial conditions 
gives the same macroscopic evolution even though the 
system must have vastly different micrescaplcrinatial 
conditions in each repetition of the experiment. Thus, 


it seems plausible that, in such Situatians tethecensemble 
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average could be identified with the macroscopic measure- 
ment since the macroscopic evolution is not sensitive to 
mmenprectse initial: conditions. Of course, it is*expected 
that there are some situations where this is no longer 
eeue aid tinswhtch®this statistical method is not valid, 
but it is hoped that the common non-equilibrium situations 
are not of this perverse nature. 

En ipeaeti ce; eitheredep kaustibleminitial distri- 
bution is assumed and its development followed, or else 
an attempt is made immediately to simplify the description 
by considering reduced probability distributions. The 
former approach is used, for example, in linear response 
theory where the initial ensemble is assumed to be an 
equilibrium one and its time evolution under the influence 
Sreoneexcternal perturbation is considered’ Inethes latter 
approach, upon which the Boltzmann and other kinetic 
equations are based, rather drastic assumptions are made 
regarding the relationships between the reduced distri- 
butions and the complete distribution function. 

iiuseeeal though in princi plemthemdeve opncniaor 
any initial probability distribution can be found and then 


macroscopic averages may be taken over the resulting time- 


dependent ensemble, in practice this is not often possible. 


This is due to the lack of any simplifying feature such as 


that provided in the equilibrium theory by the time 
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independence of the ensembles. The assumptions which 

must be made in order to obtain concrete results put 

much of the non-equilibrium theory on a much less secure 
Footing than the equilibrium theory. In many cases, the 
Only test as_to the*validity of the statistical assumptions 
made iS comparison of predictions with experiment. 

Despite this, there are many useful and valid results in 
foe-classical statistical. theory of non-equilibrium systems. 


Some of these will be presented in the next two chapters. 


88.3 Quantum Mechanical Formulation 

In quantum mechanics, the statistical distribu- 
tion operator or density matrix that is analogous to the 
classical distribution function pte ome, ey may be 
introduced in two fundamentally different ways (cf. ter Haar 
[26]). The first method is due to von Neumann and is 
essentially the same as the introduction of the classical 
distribution as discussed above. To reformulate the 
classical theory in quantum mechanical terms, proceed as 
follows. 

If the state of an isolated quantum mechanical 
system is known as completely as possible, then it is said 
to be in a "pure" state. The system may then be completely 


described by a wave function ~. The expectation value A 


of an operator A is then given by 
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Reet, Apy (8.1) 


The wave function WG eee Xt) may be expanded in terms 
of a complete set of time-independent, orthonormal 
functions to,t. ia teas 


WOR,  Seeixe st) ey C 
n 


where all the time dependence is contained in the 


coefficients c(t). With this expansion, 


f= 5 ae Cornea) : (oma) 


The pure state corresponds to an exactly ‘specified inital 
State in classical mechanics and the only statistical ideas 
introduced so far have been in the purely quantum 
mechanical expectation values. 

On the other hand, just as in classical mechanics, 
practical considerations limit the available information 
about the system. Only a few parameters of the system 
are known and the values of the other physical observables 
are unknown. Thus, the natural procedure in quantum 
mechanics is also to introduce a representative ensemble 
to represent the uncertainty in initial conditions. If the 
members of the ensemble are labelled by the index "k" and 


have wave functions on, then the ensemble average <A> for 


an ensemble of N system is just 
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N 
<> = 7 2 (ve, awk) 
Ka 
wal : ecole) (ct Ciena (8.4) 
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If an operator p, called the density operator or matrix, 


is introduced, defined by 


N 
= ead we k 
pre Nie ones RS A) ae ie? Cate CHa) (8.5) 
then 
ee NG 65) A Oe) COO 01d) 
mia peieer m 
Set LOAN ys (8.6) 


Since the trace operation is invariant under cyclic 
permutations, the ensemble averages are invariant under 
unitary transformations of the basis set io, t. ANsion 
poOveuthat,o 15 Hermitian and that Troe =) 1 

In the language of quantum mechanics, the 
general situation considered above is a "mixed" state. 
A mixed state cannot be described by a single wave 
minction., Dut has some probability of being in different 
States. The diagonal entries of the density operator 


give the normalized probabilities that a given state on 


Hoerealized at time t. 


ene hy Vick ee A |) oh ie” Cm 
! Ae " i ; ’ re a ah Ay ea AY ays 
Lh ' 7a natin i ‘nt ’ we ‘¢ Ly 7 
: ou ‘ i + nie at i” iat 
i Se one ey 
% A y 
i ew ‘ 4). & 
oe : 


a | (Pb. 8): ; ie 


ae KEV oO NOteRa gE ga oat welies 4 “Wot tones 
| | ane ae “ed bent tab bit 


. i iM ane ee 
ye | 
* ' ) 4 +. -_ ¥ ¥ “ ms > ae 7% 
(2.8) (2708 (2 } a? em hae q ra, 7 atl ” | 
; ve, es rs 
ie) | ; ene . 


(0.84 


ie rehire. Poa Tew es 


att hihoaiihabhaia wr 
Bi aatgpe, ‘Box te ae ‘et ov Tee 
| a bw atpnie. ‘5 xe node seed rn , 
aatiey vt phind: 70) an 
‘Aptis 290 votensh erty a 


aad ase navy Ry vba es 


a 
in 
al i; 


A) 
ve 
i] 


ve a at wit Wve 
as : ‘ 
y ) v 


162 


Such a density operator has not introduced any 
fundamentally new ideas into statistical mechanics. It 
resulted from considering representative ensembles with 
the main difference from the classical case being the 
replacement of exact values of physical parameters by 
quantum expectation values. As in classical mechanics, 
iteyemains to,specifysan,initial value of thesdensity 
matrix by other considerations. Once this is done, the 
time development of o may, in principle, be determined 
from the quantum mechanical version of the Liouville 
equation which governs the classical distribution function. 
This equation is known as the von Neumann equation. 

It is worth noting that an approach via the 
Liouville equation in classical mechanics or the 
von Neumann equation in quantum mechanics is valid only 
for isolated systems, since these equations are 
deterministic, dynamical equations for isolated systems 
andseonkyathetini tiaheconditions are statistically idistyts 
buted. Although it might be expected that non-isolated 
equilibrium systems would behave in a similar manner to 
isolated systems with the same energy (e.g. equivalence of 
Canonical and microcanonical ensembles), there is no real 
justification for such an expectation in non-equilibrium 
systems. This point is important when considering the 


formal theory of linear and non-linear response in quantum 


mechanics (cf. Chapter XI). 
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There is another way to introduce the density 
matrix which does not involve the use of ensembles as a 
Starting point. This approach, which is sometimes called 
the quantum mechanical approach to the density matrix as 
opposed to the statistical approach above, is due to 
Dirac (1930). It has the advantage that it naturally 
deals with non-isolated systems as well as isolated ones. 
Its disadvantage is that it does not provide an equation 
of motion of the system's density matrix without a 
detailed knowledge of the system's surroundings. 

As an example, consider a many-electron atom. 
This atom may be assumed to be in a pure state, described 
by a wave function ¥. However, even for a two-electron 
moot, 9t Nas not been possible to find ‘an exact analytic 
form for this wave function. For more complex atoms, 
even finding numerical approximations to the wave function 
Psavory difficult... On the other hand, if only the energy 
posuch lanoatom 1s of interest, the appiroachaViautie total 
wave function 1s2 wasteful. “Since all the teryms in ithe 
Hamiltonian involve coordinates of either one or two 
particles, all the averages of interest will be over at 
most two particles at a time. Thus, if the one and two 
body reduced density matrices are defined by integrating 
W*Y over all but one or two of the coordinates, then a 


knowledge of these reduced density matrices isssufficient 
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to determine the energy of the total atom exactlyia Lt 

may be said that the rest of the electrons act as a 

"heat bath" which introduces a statistical distribution 

of the one and two electron reduced density matrices, 

even though the total system is in a pure state. Although 
the reduced density matrices are useful in quantum 
chemistry in precisely the above form, the idea may be 
generalized to thermodynamic systems. 

In a system with many degrees of freedom, only 
feeew Of vtheseraresusualhyfof interesti« Collectively 
denoting tnose of interest by x, and the rest by q, the 
total system has a single wave function ¥(x,q). The 


reduced density matrix op is defined by 


ees Yr 'g) oY xa qy.da : (8. 7.) 


The quantum mechanical average of an operator A, which 


depends only on the coordinates x, is 


<A> = ff v*(x,q) A ¥(x,q)dxdq 


Ie (x ox) (AX paxdx: 


Tr[pA] é (858) 


Consider the case of a system S consisting of a 
Subsystem S, which is of interest and another S5 which is 


not. Then, integrating over the coordinates of So gives 
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the reduced density matrix for Sy: In the special case 
where the subsystems do not interact, the total wave 
function is a product of the wave functions of the 
Subsystems, so the reduced density matrix for S, 
eorresponds to a-pure state of Sy: If, however, the 
Subsystems interact, the subsystem Sy cannot be described 
by a single wave function and the reduced density matrix 


worresponds to.a statistical description of S$ The 


1° 
Subsystem So may be made very large and thus may be thought 
of as a thermal reservoir for S;- It is then the inter- 
action with this reservoir which gives rise to the 
eeatistical distribution of the reduced density matrix 

even though the total system is in a well defined quantum 
state’. 

Although this gives an intuitively satisfying 
explanation of the introduction of density matrices and 
representative ensembles in quantum statistics, it does 
not solve the practical problem of how to find the density 
matrices. In order to rigorously justify an assumption 
about the form of the density matrix of a particular 
system, the complete solution of Schrédinger's equation 
for the system plus its surroundings must be known. Since 
this is almost never possible, the above approach is not 


practical for large systems and an ad hoc assumption is 


usually made about the initial density MNase bake 
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This concludes the discussion of the general 
foundations of the statistical method. The limitations 
of the theory should be kept in mind in succeeding 


chapters but generally will not be mentioned explicitly. 
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CHAPTER EI. 
CLASSICAL STATISTICAL MECHANICS AND KINETIC THEORY 


89.1 Dynamical Equations 

Although it is certain that the correct approach 
to any mechanical or statistical mechanical problem is 
moroughi application of quantum mechanics, it is still 
worthwhile to study the general statistical mechanical 
problem by purely classical methods. One reason is that 
there is a ite range of physical systems in which quantum 
effects are negligible. These include dilute systems, 
high temperature systems, and much of macroscopic 
hydrodynamics and continuum mechanics. Also, it is 
possible to derive many formal methods of solution and 
some exact results which are easily modified in the 
quantum case. Historically, some of these methods and 
one are quite new, having been derived well after 
the establishment of quantum physics. In addition, many 
general arguments about the nature of irreversibility 
apply ee any well to the classical and quantum. cases, 
although they were formulated well before the 
establishment of quantum mechanics. This aspect will 
be discussed in more detail in the next chapter. 

In any closed mechanical system, the classical 


equations of motion are Hamilton's dynamical equations. 
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However, for statistical mechanical purposes, it is more 
convenient to cast Hamilton's equations as an equation for 
eiesaistribution function’ p. This equation, known as the 
Liouville equation, may be derived as follows. Consider 
desystem of N particles. Lts motion may be described as 
the motion of a single point in a 6N dimensional I-space, 


obeying Hamilton's equations, 
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where the dot denotes the time derivative. 

If now an ensemble of identical, independent 
systems, with a density op of representative points in 
T-space, is considered, then, since members of the ensemble 
are neither created nor destroyed, the density p obeys 


Pemecontinurey equation (ct. 32.1) 
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and using Hamilton's equations gives 


x a N ar, aD. 
V X= Bees 2") 
Xx ; = > 
galheear dp 
N 3fH, aH 
re . ap.  ap.ar | 
i= r. op, 3p. or. 
=._0 (9.4) 
Therefore, 
N ; 
ce} + yy. (y ° V e) +p e v = 
p) = 0 (hated 
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Again using Hamilton's equations gives Liouville's 
equation 


BP . 
al lye es (9.6) 


where {A,B} is the Poisson bracket of A and B, defined by 
ee 2 St he Paks hVetBise(VeeA] SGU AtB)] , p: (9.7) 


The Liouville equation, although exact, is of 
iinited value. since 1t.1s.far too complex tossolve Ineits 
Ebuinety Or realistic physical systems. "Instead, the 
usual course is to make some approximation which involves 
the loss of some of the dynamical information about the 
system, yet which allows a reasonable determination of 
fe quantitiessof imterestie= A systematic procedure for 
doing just this is embodied in the BBGKY hierarchy of 


equations (introduced by Bogolyubov, Born and Green, 
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Kirkwood, and Yvon, independently). Before deriving this 
hierarchy, reduced distribution functions will be defined. 
First -"éonsider "a “function PN hee ee proportional 


to o's ‘such that 
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where be = cos Ds) and the integral extends over all 


[T-space. Also, define the reduced distribution function 


on order &, by 
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Sincetne particles are Vdentyoalt sp anced 
are symmetric functions of the ie and so the reduced 
distribution ‘function fi") is also symmetric in the nee 
independent of the particular choice of 2 particles. 
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In order to derive equations for the evolution 
of the fie). integrate Liouville's equation over all but 
more cne coordinates. This procedure, yields, an exact 
formalenierarchy forthe reduced distributron) tunctions. 
Once this hierarchy is found, some reasonable approxima- 
tion to one of the distribution functions may be made, 
yielding approximate equations for the lower order 
Gastribution functions. 

Consiider-a, system of N jdentifeal partileles in a 
volume V, influenced by an external potential o(r,), and 


interacting via an interparticle potential 64, (1ry-F51) 
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Thus, integrating Liouville's equation over 


(N-2) coordinates gives 
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This set of equations is the BBGKY hierarchy. For the 
Hamiltonian considered, it is exact and it relates each 
reduced distribution function to the distribution. function 
of one higher order. These equations are again not 

Goch oi this, formsince,sin. order to.find aud) p62) 
must be known, and so on. Thus, the equation for p (1) 
implicitly involves all the nigher order distribution 
mince ONS. siowever.. 1h Many physical. SituattOns ,e1t ls 
possible to ignore or to approximate the second and higher 
oracer distributions !/and! thus’ to.solve for pale. Also, 
Sacer dl ise tne case where Neo, Voor 5 constant which is 
of interest, (N-2)/V may be replaced by n = N/V, slightly 


Simplifying the equations. 


§9.2 Vlasov and Boltzmann Equations 


(1) 


As an. example..consider the equationmtor sf : 


GO a 4 (1) 
af ] > (1) = > ck) igotem? 
22818 : f at EO Che i) ay wate) 
iy ery iol Py pee) ee 
(Qn1t73 
where 
ie ee (Foy) (FF Nashdips see (oe) 


A) bit er Oe et ay aes ne bh 
SR aa Nr AY ee itt Oo Pe 
‘ , ls q yi ¥ } 
y oe 1 ‘ Ry | 7 
hy : Adi i my 4 fn 
\ uJ i i) i Ae va qi 
' Doh us TP : 
Yea is 4 ; 
is We ‘Qo 
x 7 
et 
i . 
; , o 
i 
a sehaowninn 
LaF i@) iS 


eat ae | ; oe 4 
Ga omg) 21 eH pits on 3 2 
' 


i He 


, . : * ‘i ‘ “7 a , ; 
Noss eaieh aw ar "ae shih hd era bovad}an 109 ns Mis 
i aay ie 
3 


‘ | Py 
a? nc tudisd tnd 


ied 
aad PY 


a 


Ao ra onyy b rat ee » Fh ong a ae at 
a] 


Hon nkspe SMe Tat eons 9% gent cate aa 


iP ha ok a abies ant Lantz wo? ‘ead att 
Wi aks v Wy aL an if ny 


} ' 0 ig | } 3 ay) Leasaty vA Qa 62 as ’ snwon 
‘Oa are) r ‘ 
i 0 i Rl Cea a 
nofIwarape ro. YeIVG ie had ad 4 [6 2969 fovn Pai 
a cee | i (ie os 
oh $t ccenbiaeitue fav ae a 19¥ swok ot 
f 3 . NR w € | ae #9 


AOR ne a eins OOS Ae rie os "0 sth vs + alt 
Bie. ' uy ee i 


| | ine 
STA oe eo See jet iad ne phe twd ents » E- 


va rp bg ca +A a fa £Q e 13 LW “" 
yi Sip ih, tq v x ee an, Ay A fa) iu 


ae | tn ie nt 
} Ata yo me i reek i) a 


15 Big, vos 


a 2ror vie Bip Bo iia . 

; 4 Aue 7 é av Me ay wg 7 ‘A 

OEMs VOI KOfiaunNs ene vay alone i Le a 
i | Pi . ey re or m “i 


iy 


~*~ - 
a 


if arn 
4 a iii nS 


| eh. 


If now a system is considered in which the 
interparticle forces are long-ranged and in which the 
short-ranged repulsions are unimportant (this may be a 
good approximation in a dilute plasma), then each particle 
isnt luenced by many.athers at.all times... Thus... each 
particle moves in an averaged "mean field" which is 
roughly the same for each particle and the particles are 


noesstrongly correlated. This makes 1t possible to write 
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is the mean interparticle field gradient. 

This equation is known as the Vlasov or mean 
field equation and is important in plasma DRYiSVOS.. - “at 
differs from the Boltzmann equation in that the inter- 
particle interactions are treated as a collective potential 
whereas, in the Boltzmann case, the interaction is assumed 


to result in discrete binary collisions between almost 


independent particles. 


er 


, 


J Tete asad ay ta 3a ie ‘6, 28e Tap abe. 


ay d ; : 9 vie > 
SE eT eNRY, SMB ie). “hg Hie vst brs nla 


— Oh all | 1 j ih ; 
mh ec) P| 
| 
oh i i m Wek 
b. ¢ 7 » TOT 
ty kd ie ~ = 
hes uy 
Sas 
- ‘a ' 
i ‘ ¢ ey 1} ’ a ° >) 7 i< 
Re i 4 
| mG: fy S20 hh Brrr oe re ei 
a. a ' 
ee ur j ’ ‘ a 4 : i 
be Ue ome 4 yi) Yvie w “A b 7 : 
F i a f ina , 
; a: kane oe Taal ee a 
ia74 fh” Papaysvys os 1! nh oni” | ofS 
= < aes in 7 
‘ 
5 5S OLata 26a 9 vi mee 
Wn SpA / in4 Bees ae)? 
ec 
ee me ae )s - ~~) 
\ ? fs } , a \ : fit } 
f 1 


ey Ssups Sit. Aott oh iFRON GB 
ba é ; " yi + ’ we 
Poe FL a ' j in Ny 
nee ee i: ae 4 
z . j t \ Y)® 4 } . t c 

1 i Ve" © 

rh his a, as r 

mee a 


| ts ut MES 8 te 

bang anh BI risqnotel ns ; add 

. ear (0 ab. 
Teen Yo voesty sid. 26 c nh He! s6up. fea lg 
Syn : vy 


An 


a4 . at ae * va ae oy, Ue, 
“Vaane FAD) Sey, i wis ‘ei fie. Kens hed: 4. La 


; ii i 4: a ae a) 
a = enn 
ae ert 


In order to derive the Boltzmann equation from 
the BBGKY hierarchy, first consider the original 
intuitive derivation due to Boltzmann. The most 
important assumptions in his derivation are that the 
Systemris'so-dilkiftte that only binary collisions occur 
(this also assumes the forces to be short range), that 
ome enrects’ of external fields upon the dynamics of a 
collision are negligible, and finally that the number of 
collisions in a given volume, per unit time, can be 
Statistically computed from pl) ahOne .. Mec Sethe Shiver 
assumption (Stosszahlansatz) which allows a truncation 
of the BBGKY hierarchy. 

To actually derive the Boltzmann equation from 
the sBBGKY -hieyarchys» certain assumptions, similar to those 
madenby Boltzmann «in.his derivation. ere mecessary.) for a 
dilute system with short range forces (e.g. neutral 
molecules), the most important feature of the potential, 
asatareds<co Lita Ons sare, concerned, 1S its repulsive core. 
This core may be approximated as a hard sphere interaction 
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by the value of 5 (2) near [ry-7 | =o GNWACIthETins tanttor 
collision, the probability that the two hard Spheres are 
POnLacting aythird is*infinitesimal so, for ae Gr, 
the function p\2) Se gus t ¢(2) fOeva S¥Ys'tem) of onky. two 
hard spheres. This is equivalent to Boltzmann ignoring 
Paipvencovlasvons: in his derivation. Then, 562) Satisfies 


the equation 
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second term on the left of (9.24) gives zero contribution. 
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Also, since there are no triple or higher order collisions 
and the forces are spherically symmetric, f (2) depends 


> > 
only upon halk allied ba Thus, 


eta = 4, £6e) ea. (9.25) 


Therefore, 
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pai} elon : FF aka, , (9.26) 
Using spherical coordinates, with r = |r,-ro|, gives 
ay eau seis ed rdr do db, (9.27) 


where S is a unit vector in the direction of (T)-F,) and 


d2 is the differential element of solid angle. Since 
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where Py and Po are the momenta before the collision and 
p and Ps are the momenta after. If the variation of p (1) 
is.assumed to be small over a distance o, then, since 
vGesaasl =o yust before and’ just after the ‘col 1S on is 


(1) 


and bo may be replaced by - in the argument of f, °, 


giving 
enjzah p 
af 1 = 1 > > s (ily) 
Bea sol ree he Ga enema 
(p -p ) S ee fe > > 
= le | | ie a Hysol Nir erstench sa aA 
- FF Beye (F, By.t)yan dp, . (9.30) 


A . Ste tg 
ler ew distri butvon tuncta ons” T(r v..0)* = 


Ae POPuE. 5 es are introduced,eqn. (9.30) becomes 


178 


: fi Ne > is OR Ts Ss 
bi ’ f j vane i ve a ie 
A PAS Ty Ae aaa 
\ f ‘ 4 tek ; ; he es va 
ey pie Me 


aN a pon aD fan 
iA : o- ae \ 


, f “ | ie " Xe aie , ea 

i” gi DG 5:59. p Sieg ows. xino. 2 me | 

é > ‘ é na ie ae . 

A) ‘ j she ; cs ’ 
} co | ne ‘ i OW ie an ike ao soubor: ye 
} : re i 
fe, da h , . pie in 
‘ i ; i pa] o | f $} ‘hn 
y ' , 4 ’ ’ 2 \ { i = ;_™ 
| L?er4 r} 1 (Pe, ple p * t ‘ al 
; Mi en ry Qe. \ 
; ad i | 4 a os ( ’ é ay t ) 
i x! (394 ie ‘de 2 b - A gt f 
Chien ; re | 
1 na 4 j Pi’ q ays he 
1 ey ) | J d eer i 
has: werent La ‘* Tae - $osia m Shs. &T6 34 hi 
Te bel i ay ed, ) 
=! : Al # un 
\ 5 Oo nots | ec! an i ig aga Bon ahi } 2 i3 i 918 g 


sphife giatd .o Some setbr veo flame od oF Demis 


i; 1 6) 


y ‘note ti hes eat 19 ite reub ban a erets ad 4 ent a 
, ee. 
for’ ‘ i 
ct et) FO SwaMe NS SMF st i 4a: be hae "4 ‘ed oS ae 
‘ab at 


i) ts 
r : of 
| inst {Of .©) > 
Rey fae ar + pile? Oe i 09 oy tome ore 
ee Tha i a ome aa ef ee 
; uf am i A Viele : F } » as aks - 
a ONE ee | ae ee pr ee soi “eae 7 an 3 cs % 
My al zatiesou 
Auris aR 
in ih f 


a 


: cat 


ae ) 
ay i 


{ 


179 


which is the usual form of the Boltzmann equation. 

In this equation, the terms on the left represent 
drifts in real space due to density gradients and drifts 
in momentum space due to external potentials, while the 
right side gives the change due to binary collisions. 

The range of applicability of the Boltzmann 
equation is limited by the assumptions which went into 
mesederivation. (lt obviously does not apply to systems 
where there are long-range forces or multiple collisions. 
Also, it is limited to systems without strong field 
gradients. These restrictions follow from the explicit 
assumptions which went into the derivation. The 
restrictions placed upon the system by the uSe of a 
Sctosszanlansatz are harder to specify. In order to analyse 
the Stosszahlansatz more carefully, general analysis of 
the BBGKY hierarchy is required, in the spirit of 
Bogolyubov [27]. The most general and desirable result 
would be a systematic method of expanding the distribution 
functions in powers both of density and of field gradients, 
Ppewhich the statistical assumptions involved are cleanly 
set forth. This is the objective of various methods of 
formally expanding the BBGKY hierarchy, several of which 
will be further considered in the next section. 

First, a simple example of electrical conductivi- 
ty will be studied using Boltzmann's equation. Since an 


attempt to solve the Boltzmann equation directly would 
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involve a detailed description of electron-electron 
scattering, lattice effects, and impurity structure, the 
drastic assumption of a constant relaxation time is made 


right at the start. This assumption may be written as 


(1) Er) eal 
ote. Stic) ce Ore (Oaa2)) 


Go 
where t iS a constant relaxation time and ee is the 
equilibrium value of fi!) for an ideal gas of conduction 
electrons in the absence of external fields. This 
relaxation time approximation is perhaps justified for a 
System in which the conduction electrons are essentially 
free (e.g. in a metal) and where the dominant collisions 
are with impurities and lattice sites (i.e. electron- 
electron interactions are "smeared out" to give a mean 
field @rfect).) in this. case, the collisions with 
impurities and with lattice sites are essentially random 
and a given electron will have a mean free time t between 
Collisions. if each collision randomizes the directionoy 
motion of a conduction electron and if there are no 
external fields, the system will return to equilibrium 
monotonically in a time roughly equal to Tt. This may be 


expressed as 


which yields (9.32). 
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If the system is assumed to be spatially 
homogeneous (V., ¢ (1) = 0), to be in a steady state 
art? = 0), ee to Dein san-external electric field. 
Es, in the z-direction, then Boltzmann's equation is 
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; ED oP, i 45 
or 
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For oe the zero temperature Fermi distribution of an 


ideal gas, 
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where 6(x) = 1 for ~ = 0 
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and where Ep is the Fermi energy, it is possible to find 


fT) (4) explicitly for zero temperature (cf. Trofimenkoff 
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and Kreuzer [28]). Using their expression for f ) and 
the definitions 
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for the conduction electron density n and the current J, 
yields 


2 
Gwcee (fee hE (9.38) 


That is, in the relaxation time approximation, Ohm's law 
moVas exactly for all values of ES with the conductivity 


given by 


serates—) dy. (9.39) 


This derivation differs. from the usual one (e.g. Ziman [29]) 
in that the Boltzmann equation has not been linearized 


prior to finding are 


89-3 Formal Methods, and Expansions 

In order to generalize Boltzmann's kinetic 
equation, starting from the BBGKY hierarchy, it is useful 
to define several operators and to examine their properties. 
Much of the following discussion will follow Bogolyubov 
[27]. The system considered will again consist of N 
identical particles with Hamiltonian (9.11). 

The distribution function obeys Liouville's 
equation (926). “From a ‘formal point of view, the 
Liouville equation is equivalent to the full dynamical 
equationseor Hamilton. »Jhus, sal@hough p(N) has a 
statistical interpretation, it is possible in principle 


N : 
to follow the exact time development of ly This may be 
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expressed by formally defining an N-particle time 
development operator g(N) (also known as a "streaming 
@perator") which replaces.the initial values 

Be) sc 3X (0) by their values Rate ya aennlia at time 


woe nat. 1Ss% 


(N) 


5 N 
Xoo sa Xystl = OEE Meas eet el . (9.40) 


me also a Liouville operator Ly is defined by 


iS = wale Hv (92 4]5) 
then le = j Ly f(N) 
SO p6N) may formally be written as 
Maman) ete eR eel ca), ee (aay 


Therefore, 
5 (N) =e i d (9.43) 


Miso. it 1s useful to define thesauxilianry g-body operators. 


If Lb, and g(t) area fined by 
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where H, was defined in eqn. (9.16), and 
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Writing the BBGKY hierarchy (9.15) and letting 
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The terms in this expansion have simple 
m@eerpretations. the first. term on the right isthe 
unperturbed motion of a system of & particles. The first 
correction term, proportional to n, describes part of the 


effect of the other particles. This term results 
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additively from the action of each of the (N-2%) other 
particles separately. The term proportional to n@ results 
from the interaction of the group of 2 particles with two 
other .apanticles, ete. 

This expansion, which is equivalent to that 
derived by Bogolyubov [27], suffers from several 
disadvantages. Firstly, although it is formally a 
aensityreexpansion,.in fact,.if the.distribution. functions 
were normalized differently, density would not appear in 
(9.47). Actually; such an expansion must bein. powers of 
Baie dimensionless parameter (r3n) where Ge is a length of 
order of the range of the interparticle potential. To 
recast the expansion in terms of such a parameter is not 
easy, due to the complexity of the terms. 

Secondly; it has been found (ef. Cohen i30)) that 
Such an expansion gives rise to secular terms which increase 
without bound for increasing time and hence any truncation 
Gieedn. .9.4/)-would lose its Validity for large stimes. 

Lastly, this: expansion tS notsuserulea or 
Computations since, in order to solve for eee the exact 


time evolution of pletl) gl2t2) must be known, as in 


the original hierarchy. 
However, since eqn. (9.47) is, in principle, an 
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mwiesrower order’ distributions. "in parti cular. it would 
be useful to generalize Boltzmann's equation for p (1), 

im ordem to’ do this, it 1s° necessary to make 
Some assumptions regarding relaxation of correlations in 
the system. This is the vital approximation which allows 
one to avoid the necessity of solving the complete N-body 
problem. It also clearly is an assumption which should 
be carefully analysed before the resulting kinetic 
equations are applied to a given system. 

To justify the approximations to be made, 


consider the general form of the BBGKY hierarchy 
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assumed that, in physical systems, correlations disappear 
for large times. Explicitly, it is assumed that the 
dynamical evolution of pie eb) ( fidr £222) Fismico mime te ly 
randomized after the time Bes and the only remaining time 
dependence is through the functional dependence of p(%) 


(1). 


upon f Nims’; Safiter tthe siniithaliustage tems Tenis 


possible tovidentify a second, "kinetic" stage “in which 
pl) alone visi isut iticientsto zdesonibe the ‘sysitemem lin 
this stage, all the initial correlations have died out 
and the system can be described statistically in terms of 
pt), This is tne generalization of the Stosszahlansatz. 
The system also possesses a second characteristic time 
Cae of order of a particle's mean time between 
ec li imistnons!.. For t>>ts nearly all particles have 
undergone collisions and these collisions have changed 
fl) to an almost equilibrium distribution. In accordance 
with the ideas of local equilibrium in Chapter I, for 
t>>t, it is no longer necessary to know Aon in order 
to describe the system. In this third, "hydrodynamical" 
Stage, the macroscopic mass, energy, and momentum 
densities are sufficient. 

It should be noted tnat, if a system has long 
range forces, or is very dense, the time tT may be of the 
Same magnitude as t > and no kinetic stage may be 


identified. However, collective interactions may still 


return the system to equilibrium very rapid ly: 
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VWowderive Kinetic equations 1tlis first 
assumed that the correlation functions f(%) for t>0 ware 


determined by the value of p{l) ateteOu abhatedse 
VOC ites a tas ABR animes Weigh Ufc Pc) 00) 


ouch a SOtution*is not the mostegeneral,isinee the’ initial 
ars tribution Tee Apoan rsa 10) cannot be specified 
erpitvarily with this ansatz, but is fully determined by 
B(x 450) « thus incorrectly eliminating some physically 
realizable initial conditions. However, in view of the 
above arguments, it is hoped that by "coarse-graining" 
(i.e. averaging) over a time of order tie the necessity 
oeconsidering,the precise initial conditions can ve 
eliminated. 

In order to analytically formulate the 
condition that the correlations may be ignored, define 


: : a 
an operator ae and a correlation function a! ) by 


x 
> =o ] > 
OU GAD oeCOer ee Caper ee )(%,.0) (9.50) 
and 
se 
(2) > Cae (2) ‘4 Lk) es 5 x 50) I Saas 

Be TE hgh S 2g ME 191 998% n 24m 2 hy Q hae tages 

(9°51) 
Then, ax, - 2X, s0)=1 if there are no correlations 
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The assumption that there are no second order 


correlations present at time t may be written as 


Ae Usa ire 2a) Saale Oi ae AD Wie 
G, (xX) Xo) = San (X1 2X5) S; (x, ) Sy (x, ) 
(9253) 
Obtained by setting 46) = 1. This is an assumption which 


implies that two states with the same values of pil) will 
evolve to the same state at a time SE regardless of 
mitaal correlations. This can only be true in a 

Goarse grained sense, but this,may be sufficient. For 
(9 at eae Give ex) is independent of t since 

s(2) (XX) differs from Sh) (09 SS Wie lgeniy arene 
particles are separated by less than vet Writing 


g(2) = 1im ai?) 


| agate 


and ignoring correlations, the BBGKY equationadorasr - 


in theskineticistages is 


(1) er seh ies 
ea arg AGL i Naor Gk cya kylt ne et ey 
dx, (9.54) 
Using the notation 
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aA CSEEISES > 57) ey Xp) , (R ) (5 hy) PY (9%) 
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to denote the initial position and momentum of the jth 
particle and defining ir = ir ee gives 
MeN en les Lae) pe) ene 
ae eat oo oes 
R62) (x x a Pere Lr. + 1, (2) (3 X \r 9 
2 Ky »Xp We 22) 2 Pe oe 
Thus, 
Zc > (1 > > > 
Nf tdyo2Ge (X1>X5) f (x, ,t)f' ‘(x,.t)}d Xo 
spuniaies dee obednbt W.ghW) yg (9.57) 
where 
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(9.58) 


and where Jpanenad’ >) contains correction terms which 
may be ignored if the change in p\1) is small over.a 
distance of the order of the interaction range. The term 
involving cp yep) is identical to that considered in 
§9.2 and, by the same arguments, can be reduced to the 
usual. form of the Boltzmann collision term. The 
correction term involving Jy can be calculated for a 
hard sphere potential and is found to be important only 
for strongly inhomogeneous distribution functions. 

The extension to higher densities by including 


some of the correlations is quite involved. However, 
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the Boltzmann equation is sufficient to describe moderately 
fence gases “and, cifijorder,to describe liquids or ssolids. 
many terms would have to be kept, since there are strong 
correlations present. Therefore, it may be that such 
extensions are not very important in a general survey of 
non-equilibrium systems and are of limited calculational 
penetit due to their complexity. 

In the next section, balance equations for 
continuous media will be derived directly from the 
BBGKY hierarchy. Before presenting the derivation of 
these equations, it will be shown how the methods used in 
analysing the BBGKY hierarchy can be modified to deal with 
the response of a system to an external perturbation of 
the Hamiltonian. 

Consider an isolated system with Hamiltonian 
+ If an external perturbation, described by an interac- 
tion Hamiltonian Hi» 7s gwitehed ongtat t-0, then ene 
perturbed and unperturbed motions of the system will be 
gaifterent. lf aN) is the distribution function of the 
unperturbed system and if p iN) = iy) a5 f iN)" is the 
distribution function of the perturbed system, then 
#(N) 
ot 


) 
s ge tN oy eno (9.59) 
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f (N) were 
and — ed ieee det vl - (9.60) 
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Eqn. (9.60) may be written as 
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Using the Liouville operator Ly defined for Ho» this tcah 
be converted to an integral equation as 
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If e F (xy oe es 9X50) is written as fy (X15+-+5Xy st) 


and the interaction Hamiltonian is written as 


Hy = -u F(t) A (9:263)) 


where A is a time independent operator, F(t) is a function 


Siecine whiebais zero for <0, and u lis. a coupling constant, 


ten iterating eqne)(9.62) yields 


t iin p(k-1) i(t t')L 
[oe 71 - 
pepe NI (tye a (n)Rfat' fact... dt!) re ; 
k= O O O 
Ay: , eMR31)_.(k) 
ren “ Ce Neg OND CEC y 
A ehar tens dercesbengt o (9.64) 
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For a time dependent f’ ’, eqn. (9.63) suffers from the 


same drawback that the expansion (9.47) of the BBGKY 


hierarchy had, namely that, as t increases, the accuracy 
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of a truncation of the series decreases. Thus, for general 
time-dependent problems, the validity of a finite sum of 
terms in eqn. (9.64) is limited to very =short times?’ ihe 
time range in which such an expansion can be valid will be 
investigated in more detail in Chapter XI. 

On the other hand, steady state solutions long 
after the perturbation has been switched on are often of 
meerest;s particularly for transport phenomena. In this 
case, it is more convenient to assume that the system is 


in equilibrium at t=-© and that Hy is switched on adiaba- 


circaliy, Starting at ~t=->'.° That iss -assume 
-BH 
(N);> > _<(N)/2 > yA 0 
Is (X1 5-22 9Xyst)=fo (Xp 5-+- 2X) ot Ja e (9.65) 
(N) ; 
In this case, the expansion for f (a) eis 
t t. pikody 
2 ' " k 
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k=] =—©COo = CO =—0O 
-] k 
Gir a BF Tt etal ea se 
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[e x {e Ae eie ; 
Ge te Ge) lee (9.66) 


This equation again requires an exact knowledge 
of e N the time development operator of the unperturbed 
System, for its solution. Its quantum mechanical analogue, 
the response theory of Kubo, is much studied and, for 


example, is used to derive Onsager relations, fluctuation- 


dissipation theorems, and sum rules in the steady state. 
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§9.4 Microscopic Derivation of Balance Equations 

In order to derive macroscopic balance equations 
from microscopic foundations, it is necessary to express 
the macroscopic densities in terms of the distribution 


functions. The macroscopic mass density p(r,t), fluid 


velocity vir, t), thermal kinetic energy density 5 « Tre) 
and mean interparticle potential energy density e,(f,t), 
may be defined as 
o(t) = mh) fp FFB) a%8 (9.67) 
Wee > 
wt) = 4H) f pe FB, ta (9.68) 
ee Ter ties in) (B-mv)* 61) 3 p,t)d>p (9.69) 
Pots Poy 2m ie i 
and 
> > > 3> (33> «C35 
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in agreement with the usual microscopic interpretation of 


miese quantities. As in Chapter Il, “the energy densities 


are specific densities. 


To derive balance equations for the above 


quantities, consider the first BBGKY equation, 
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where -V .0(7) has been replaced by F to conform to the 
notation of Chapter II. First, simply integrate this 


equation with respect to De This gives 


(2) ) 43% Sisal Ase a 


(1) ‘eee > a > 
poop + Pe as - Oreo) We 7 d°p, dp=0 
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This may be written as 
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Using the divergence theorem and the asymptotic behavior 
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of fl) and f as |p|+» shows that the last two integrals 
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This is just the continuity equation for a macroscopic 
medium, derived from microscopic foundations. 
For the second balance equation, multiply 


A => 
eqn. (9.71) by p and then integrate with respect to p. 


This yields 
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where the divergence theorem was used again to show that 
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Next, multiply eqn. (9.74) by V to get 
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Subtracting eqn. (9.78) from eqn. (9.76) gives 
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gives the balance equation as 
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In order to cast the last expression as the divergence 
of a pressure tensor, write the functions in terms of the 


center of mass and relative coordinates 
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mere; r = |r|.) Then, rewrite p in center of mass 
coordinates as a. defined by 
> a 
= sa Z r! ee 
eo) aah et = ah (RE Re, t) : (9.86) 


The last term in eqn. (9.82) becomes 
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distribution function pf?) varies slowly with R over 
molecular dimensions, then only the first two terms in 
the expansion need be kept. Note that, since > (2) 1s 
symmetric in r and ry 7 (2) iseven Tin Worhus : 

(2) 


expanding p in “expression (9.87) ‘and changing ‘the 
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Therefore, defining an intermolecular pressure tensor 
po) by 
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gives the balance equation in the familiar form 
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where the total pressure P is just ( 


As implied by its ieneteres ) is a purely kinetic 


glk) 4 Blo), 
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term and would, for example, be present in an ideal gas. 
The terniP ie is due to the force exerted on a fluid 
element due to the short range intermolecular forces. 


The balance equation is exact to the extent that 


variations of pl?) are small when R varies over distances 
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of the order of the interparticle forces. This would be 
Satisfied in the kinetic and hydrodynamical Stages ina 
System. In a situation where this balance equation fails, 
any generalization of the pressure tensor would be of 
little practical value, since the rapid spatial variations 
in ae would mean that a microscopic description is 
necessary. Thus, the given expression for the pressure 
tensor is valid in the domain where a macroscopic. 
continuum description of the system is sufficient. 


Oo 
From the expression for P, the hydrostatic 


pressure p may~also be found as 
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Using the definition (9.69), this may be written 
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The. first. term an eqnz)(9,938)4is just, the, ideal 
Gesupressure: and, the second. is, tne correction due Co 
imteractaons.. Ihe interaction term varies Insratner a 
complicated manner, but at low densities is proportional 
to né and decreases with increasing temperature. Ina gas, 
where n is small, the kinetic pressure term dominates, 
but in liquids, the second term is important and dominates 


the behavior of p. This is the basis of the qualitative 
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differences between pressures (and Similarly viscosities ) 
OreriGuids and, gases. 
In a similar manner, it is possible to derive a 


balance equation for the total internal energy density 
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(9.97) 
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dh d°p, dp (9.98) 
: (o5) _¢9 rn . 
In the expression for Sig - ‘ F | )(f' F3B.B, ot) is the 


second order distribution function defined in terms of the 


center of mass and relative coordinates by 
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For details of the derivation see, for example, Green [31]. 
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With the above definitions of P and Jq? the 


balance equations are precisely in. the 7orm of Chapter Hit 
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Moreover. they give microscopic formulae for the 
, Eons a = (are) 
phenomenological quantities P and Jq: Although f and 
f (2) are not precisely known, using suitable approximations 
to them can yield useful results. 
Before leaving this section, note that the 
balance equations can be generalized to multicomponent 
© & ; 
systems. Also, note that P = Pe VoMmS <Sy.mmet by: 
ap Ba 
which is assumed in classical hydrodynamics and which was 
GescussSed 1) $2.15 15> Vigorous ly Valid only for. central 
cEwo-pDody interactions, since this assumption 1S implicit 
in the fOVimneotr puney Doak) nterarchy. 
The various methods and results of this chapter 
are quite easily generalized to the quantum case, and 
minis writ be done, in some .a~etall in later chapters. First. 
mr enapter xk. a discussion willbe given of some ror tne 


fundamental problems of irreversibility itself in 


classical systems. 
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CHAPTER X 
IRREVERSIBILITY AND #-THEOREMS 


§10.1 Boltzmann's Equation and Irreversibility 
Classical thermodynamics was based almost 
entirely upon the idea of equilibrium states. As such, 
it was a logically complete theory which did not concern 
itself with non-equilibrium situations. However, it 
Seemed desirable to supplement the theory with a statement 
that all physical systems either were in equilibrium or 
would reach equilibrium if given enough time. Such a 
Statement would be in agreement with many observations, 
Such as the tendency of a gas to expand to fill a 
container or for a solid to reach a uniform temperature 
equalito that of its surroundings. A statement of. this 
irreversible tendency to equilibrium was supplied by 
the second law of thermodynamics which states that entropy 
always increases or, at best, in equilibrium remains 
constant. As long as thermodynamics was regarded as a 
fundamental theory, such an approach was satisfactory. 
However, with the advent of kinetic theory and 
statistical mechanics, an explanation of observed 
irreversible behavior, in terms of a microscopic theory, 
became necessary. The first serious attempt to provide 


such an explanation was due to Boltzmann and was expressed 


in his famous H-theorem. 
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In order to demonstrate the irreversibility 
inherent in the Boltzmann equation, consider the case 
where there are no external fields (#(r) = 0) and the 
distribution function is initially homogeneous 


iy t(r.v.t) = 0). The Boltzmann equation is then 


of os 
= of (10.1) 


peo) S| Lh tlt dads 


toy) 


2 


where, for convenience, Fis fos fi and fo have been 


defined by 
> > > > 
‘ioe Se Seek ae oe aerh 
fy = f(r) >Vv) >t) ; F., F(r).Vv5 >t) (10.2) 


and ,aSrin $9225 "feis “thevsinghevpartiche tdistrrbution 
function, the primes denote velocities before a binary 
€olltsiongrandtthesunprimediveloci tres vare safiter the 
cobliston. 


Then, defining an H#-quantity by 


a is found to be 
of 


and, since 
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for an isolated system, using Boltzmann's equation, 


eqn. (10.4) may be rewritten as 


Ci 2 > > Be een oe 
geet | nf, fon f|(¥,-¥,) S|(fif5-f,f,)dad>v side vy dr, 
(10% 61) 
From the form of = it iS apparent that aa is 
dt? dt 
invariant under exchange of Vy and Vos SO 
= 5 f In(f,F,)to°f|(¥,-¥,) «S| (Fi t5-F, Fda Fy, 145%, aR 
2 Weeds Pleo 1 
Glory) 


Also, from the symmetry between direct and inverse 


Corrisions (cf. nherletskit (32) or* Kes crn and Worfinan eos |). 


dH 
dt 
inata chs ¢ 


> > saree bath 
is invariant under exchange of {Vy Vo} and {vi V5}. 


] y! if) 37, oon 
Sy f In( fy Lo erly )S|(, F,-f4 5) ded void -vid'ry 


(10.8) 


ae a Om) cand: (10-8) aGusinge them tacuses lia. 


) 
yew ig |(Vo-¥,)+S]) gives 


204 


em 


2'aphmsthos onteu .moteve pats toat a 


We 26 nas: ry na4 9d ‘Yon (e. aty 


i ey 
j 3 i ae | | 
. ie =~ X ripveet ety ts" 5 hind ane a}; rae 
i Ss . \ = 
/ 
. a ab: ; . ee e 
r One, FO. AIVOT) BAS nips 
ae Y 


1anoaKs balay 


i” 4 ia + 7 , e~ a “ a Be | 
a : -_ Le} » . ie : 
Ae Do Shak wee 
= i aa é “4 : 
2% He a j 
‘fiat 
i. ae 
| Vie i Nm Satin 2 ants 
: A m 
' Yt ai 1 37 i i V2. vt is ise t)) fad ot yer aa yihe batt 


| i) Ww iapante xs ebay nbveanlal 
; oe pee ee 


ce 7 
earl! 
Bras? pyre 
ay: | 


Due to the purely mathematical re levi onsiip 


(x-y)In(=) 2 0 (V0 1:08) 


x 
y 


nor ral =x andy: PEMis ‘seen that 


ape ay GLO rea) 


for all times and that the equality holds only for 

ff, = ff, - This demonstrates that the Boltzmann 
equation describes irreversible evolution of the single 
Oamricie distribution function from an arbitrary initial 
distribution to a final state in which if, = Fit, 

When Boltzmann presented nis H-theorem, the 
atomic nature of matter and the kinetic theory of gases 
were not well-established and his theory met strong 
Opposition. Two of the most important objections to the 
H-theorem were in the form of paradoxes. 

Thesfiryst “paradox:, due tOmboschni dtc). 
may be Stated as follows The basic laws of mechanics, 
which govern any isolated system, are time reversal 
invariant in the sense that, for any possible motion of 
the system, instantaneously reversing the velocities of 
agit the particles results in the system retracing ats 
trajectory back to its initial state. Paws, tOxV aly 


evolution of a system towards equilibrium, there is another 


possible motion which takes the system away from 
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equilibrium. Therefore, there seems to be a direct 
contradiction between the microscopic reversibility of 
the dynamics of the system and the proven irreversibility 
of the Boltzmann equation. 

Jhessecond) paradox", raised by. Zermelo.vis 
based on the Poincaré recurrence theorem. This theorem, 
loosely stated, says that an isolated mechanical system, 
Starting, in» almost any initial state, will return 
arbitrarily close to that initial state at some time in the 
ssture.co Thasimeanshythat,iif a.gas starts in anvinitiadl 
non-equilibrium state and evolves towards equilibrium 
in accordance with the H-theorem, then, by Poincaré's 
theorem, it must return to its initial non-equilibrium 
state at some later time. As the system evolves back 
howards, thes initial.state,.a@ must besincréasing sain 
contradiction to the #-theorem. 

Boltzmann's reply to these objections was 
based upon the assumptions made in the derivation of his 
equation,and it helped to clarify the nature of those 
assumptions as well as to establish the range of validity 
of the equation. In deriving the Boltzmann equation, it 
was necessary to give an expression for the collisional 
effects in terms of the single particle distribution 
function. This "Stosszahlansatz" was statistical in 


nature. It essentially said that the number of binary 
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collisions in a unit time may be found from the Single 
particle distribution function by assuming that the 
particles’ positions and momenta are uncorrelated. Given 
this lack of correlation as an initial condition, then, 
immediately after this instant, the Boltzmann equation 
holds and the H-theorem asserts that H is decreasing. It 
Pseonly by assuming the Stosszahlansatz to hold at all 
times that H is found to be always decreasing. Actually, 
if the positions and momenta are uncorrelated before a 
Dinary collision, then that collision will introduce some 
correlation, and the Stosszahlansatz will no longer be 
exactly valid. Thus, the Stosszahlansatz is an approxima- 
tion which will be valid only for a short period after 

ene initial instant. This disposes of the Poincaré 
recurrence paradox since the recurrence time in macroscopic 
Systems is very large while the H-theorem is valid only 


18 molecules in 


foresmall2times. For example, for 10 
] cm? to return to their initial state with an accuracy 
of )Ar| serge cm and |av| pie cm/sec takes a time of 
the order of 1019 years. (ch. Wuulsane 

The effect of correlations, which are ignored 
in the H-theorem, is easily seen in the existence of 
fluctuations about equilibrium. If there are never any 


correlations, then the #-theorem is valid and H(t) is 


constant so the system stays in equilibrium forever. What 
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actually happens is that correlations in the System build 


up and result in a fluctuation, which is not described by 


tne Boltzmann equation. 


810.2 A Simple Model and General 4-theorems 

In onder to see how the “arrow of time”. to 
which Loschmidt objected, arises, it is illustrative to 
study the exact evolution of a simple system. This model, 


which has recently been studied by several authors (cf. 


Bratt [35], Hobson [36], Lee [37], Kreuzer and Teshima [38]), 


Shows clearly the role of statistical assumptions and 
initial conditions in irreversibility. 

THe mode micGOnsiSts Of a DOINT particle which as 
trapped inside a one-dimensional box of length L, with 
Beorractily E@blastic walls. If, at.an anittal ‘time t=0,) the 
System list ides omibed byrcacdistributiom fumet ion (hGx Jp, t=0), 
then the Liouville equation may be solved to find f(x,p,t). 
Actually doing so demonstrates that the evolution of f 
isei rreversible in the sense that f wilh never return to 


Res) tindithira kk Value w «hAlso s tit ew leebe ono ted. pohatathe 


reduced distributions 


n(p,t) = J f(x,p,t)dx C10.12) 


co 


and g(x,t) = f f(x.p.t)dp (10.13) 


=O 


Can monotonically relax to their final “equilibrium” values. 
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The ouvanie equation is most easily solved 
breone takes care of the original boundary conditions by 
replacing the original distribution f(x,p,o0) by f(x,p,o) 
defined by 


OS xcs =e ies D 0) OY rek 


and 


tA =O DEOy) e 2) 4f (0.04.0) c 


Xai Ome PG, p).0,) «=. (10.14) 


wie solution for the new function f is the same as that 
for f in the original problem (for O<x<L) and, since the 


particles are free, 


Te ery ets Ge ae PE p,o) : (10.15) 


The solution may be expressed as a Fourier series in x. 
peLove Giving the solution. Wel ismuserul to special izeute 
an initial distribution in which the positions and momenta 
are uncorrelated. This condition is analagous to 


Boltzmann's Stosszahlansatz and may be expressed /as 
f(x,p,0) = g(x,0)h(x,0) (10.16) 


where g and h are normalized to one. With this initial 


Fondition.diteisseasily found that 


a ft 
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where L 
2 
Oe Soa i g(x,0)cos (7 *) dx ] CPO. 
0) 
foesee the irreversible behavior of f(x,p.t) it is 
easiest to consider a specific case where 
he # 27 X 
g(X,0}<= cll 60s ( r )] ; 10% 
This is chosen to reduce the Fourier series to a single 
term. Also, let 
2 
8B WZ “65 
h(p.0) = (ser) e (10. 
in order to make the evolution to a uniform final 
distribution monotonic. With these choices, 
2 
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23) 


The momentum distribution h(p,t) remains Maxwellian while 


the position distribution g(x,t) relaxes monotonically to 


the .finalrdistributtion 


g(x,~) = : ’ CTOs 


24) 
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Although both h(p,t) and g(x,t) tend to specific final 
MeUGseds) too, it IS not true that the system tends to 


equilibrium which would be given by 
i Mewes Naseer (10.25) 


Instead, correlations between p and x have developed. 
This 1S seen, in.the term cos [-™(x-P*) ] which cannot be 
Separated into asproduct of functions of x. and p alone. 
With other choices of g(x,;,0) and h(p,o), there would be 
Similar effects, although the decays to g(x,~) and h(p,@) 
would not, in general, be monotonic. 

Thus, it is seen that specification of the 
iibcial cond? tion. asia continuous distribution: is 
sufficient to yield irreversible behavior, even when the 
equation of motion is invariant under the substitutions 
D = -p and t > -t. This is not a contradiction since, by 
epeciryingyeneadnatial condition atet—0 and considering 
mesevolution tor.t>0,. an, arrow.of tame” has »been 
matroduced.,.lf, the, initial conditionsawdssstatedgasmd 
condition on f(x,p,t) at some time t, in the future, the 
system would irreversibly evolve toward that fea latipes 
condition and away from equilibrium. The supposed 
reversibility paradox of Loschmidt is thus explained. 

If a statistical initial condition is introduced at t=0, 


in order for the distribution function to evolve so thabent 
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condition as well as the equation of motion be time 
reversal invariant. If a system evolves irreversibly 
toward equilibrium and away from a given initial state and 
then, at some finite time, all velocities are reversed, 
certainly the system will evolve away from equilibrium 
mace co “the imi tial ‘state. °This ‘is’ Wot a comtradiet ian’, 
bue ‘sinply “a reflection “of “the fact “that the tim tial 
conditions in the original and in the time-reversed 
Situations were different. In the above example, if the 
initial distribution was assumed to be uncorrelated, then 
the initial condition for the system in which the velocities 
were reversed at a later time is not tne original uncorre- 
tated distribution function, but rather the .complex, 
correlated distribution to which the original system had 
evolved. 

reeshoulid be cnoted*that, for a continuous initial 
distribution, Zermelo's paradox does not occur since 
Poincaré's theorem on recurrence cycles applies only to 
isolated systems in a specific initial state. In the 
above example, this is clear since, for a single system in 
a particular state, tne motion is periodic witn period 
depending on the initial momentum. Thus, altnough the 
original system has a Poincaré recurrence cycles tne 


statistical distribution never returns to its initial value. 
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This is easily understood in terms of ensemble theory. 
If an ensemble of N identical systems is visualized, each 
member of which is in a possibly different, but still 
precise, initial state, then the corresponding distribu- 
tion function is not continuous but rather consists of a 
series Of N-delta functions, one for each member of the 
ensemble. For finite N, the ensemble and therefore the 
distribution function has a Poincaré recurrence time since 
the ensemble may be regarded as an isolated supersystem 
obeying classical dynamics. The recurrence time, however, 
is much longer for the ensemble than for a single system 
avd=)e-tncreases=rapidly with large’ N. In the limit, Neo, 
the recurrence time will tend to infinity and the distribu- 
tion function will become continuous. Thus, the continuous 
initial distribution in the above example corresponds to 
the limit of an infinitely large ensemble which, of course, 
has no finite recurrence time. 

Altroucn this discussion Claiatimes. the roller or 
Statistical’distributions in irreversible behavior, 7t 
does not provide any justification for the initial intro- 
duction of such continuous distributions. Any justifications 
of ensemble theory based on ergodic theorems apply only to 
equilibrium and are therefore not useful in studying 
irreversible behavior. 

It is often stated that a statistical distribu- 


tion is a result of a lack of knowledge of the precise 
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initial conditions. Since it is not practical to measure 
the position and momentum of each particle in a large 
system, in practice, an initial condition consists of 
Specifying a few measureable parameters such as energy. 
All of the other parameters of the system are unspecified 
and this uncertainty means that a statistical initial 
eondition ts the best that can be achieved. This, 
however, has the perhaps unsatisfactory interpretation 
that the distribution function and thus also the physiéal 
averages which are calculated from it depend upon the 
precision with which the initial conditions are known. 
This point of view has a very precise and clear formulation 
in terms of information theory (cf. Katz [39]). The 
information theoretical approach also gives a clear 
interpretation of such procedures as coarse-graining. 

In information theory, it is assumed that a 
certain amount of information is available from 
experimental measurements. That not everything is known 
about the system is reflected in the fact that the best 
possible description of the system KS. 1Aeternis cor <a 


distribution function o, whose evolution is governed by 


the Liouville equation, 
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The function I, defined by 


I = -H(t) = Se ieaa asin ab hill? (ys. oak aut) d ome dae P 
GlOn27) 


is a measure of the information missing. The function 
H(t) is known in statistical mechanics as the Gibbs 


fine-grained H-quantity. Gibbs attempted to show that 
i 0 (10.28) 


for an isolated system. However, using the Liouville 
equation, it can be shown that H(t) 1S) a" Constante 9 tnis 
has the interpretation that, as long as the system is 
isolated and no new measurements are made, no information 
1S gained or lost about tne system. 

In the above example of a particle in a one- 
dimensional box, the qualitative behavior of tne informa- 


meron funeec1on iS clear. Initrallhy, 


1/2 -B5— 
n(pso) = (se>) ai} (10.20) 
and 
g(x,0) = : ih cos (*%)] (10.19) 


and the information about momentum is a minimum, since 


(10.20) minimizes the momentum information function 


H(t) Sf wep ft yin h(pst)dp? = - (19.29) 
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for a proof that H(t) isonminimized by h@proimeseeura 
discussion of Boltzmann's H-theorem (e.g. Huang (Ou 
However, the information about the positions is not a 
minimum since, for example, initially there can be no 
Barcicles at x=L/2. As time progresses, H(t) stays 
constant at its minimum value while the information about 
position tends monotonically to its minimum value 
(corresponding to g(x.@)=7). Since Liouville's theorem 
ensures that no information is lost, information must have 
been gained somewhere in the system. In fact, initially 
there was no information about correlations between x and 
p and, as time progresses, these correlations increase. 
Thus, all the lost information regarding position appears 
as information on correlations between x and p. With other 


initial conditions, similar behavior would be observed. 


Information would be transferred between position, momentum, 


and correlations, with a net irreversible tendency for 
g(x,t) and h(p,t) to go to their final minimum information 
Values and for correlations to build up. That the final 
state still contains all the original information can pe 
seen by performing the gedanken experiment of Loschmidt. 
Reversing all velocities will cause the system to return 
to its initial state with all information intact. This 
also implies that the system can never reach a true 


equilibrium since the correlations persist forever. fhe 


true equilibrium is given by 
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=H 
f'(x.p) = = 
eee Nand 
Z 
Ped eo 
= Ti oen! e 10 Gs  Ucxc 
= 0 otherwise 
(70.30) 
ifr eee eq _ 
waich is just fi = g(x,~)h(p,-) (HOse sre) 


without any correlations. 

If an observer is limited to certain types of 
measurements (e.g. he can measure h(p,t) and g(x,t) but 
not correlations), then the above system's behavior will 
appear to him to be an irreversible approach to eaqdulnipvane 
With these restrictions on possible observations, the 
quasi-equilibrium, which includes all correlations, is 
indistinguishable from the true equilibrium. Such an 
approach to the problem of irreversibility is often 
justified by a procedure known as coarse-graining. It is 
argued that all physical measurements are actually 
averages over some finite time t. Thus, f(x,p,t) is not 
accessible to direct measurement but only such quantities 


og [sees 
f(x,p,t) = : pO pee) ea ee (10.32) 
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In the above example, if t is chosen to be one 


period of oscillation of the cosine factor in eqn. (10.21) 


ml: 5 yl 
ier (ci ee (1033) 
then 
Rix et) er (10.34) 


Note also that the coarse-graining time 1 1s 
maversely proportional to t so that any finite size for 
the coarse graining time will give the equilibrium distri- 
bution at some time tax . hus; Since the correlations 
oscillate with a shorter and shorter period as t>~, 
measurements with an arbitrary but finite precision will 
"smear out" the correlations eventually. 


The statement tnat no measurement of finite 


precision can distinguish between true and quasi-equilibrium 


mm Often cited as a complete explanation of irreversible 
behavior. It is claimed that the information destroyed 
by the formal procedure of coarse-graining is strnuly viost 
since it is impossible to perform a measurement to 
Retrieve it. 

Historically, coarse-graining was introduced 
into statistical mechanics by the Ehrenfests to derive 
an H-theorem for the Gibbs fine-grained H-quantity defined 


Pyeeqn. (10.27). Using X to denote all 6N coordinates, 


the H-quantity is 
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H(t) 2°) o(X) ina (k)do x (10.35) 
if 
where the integral is over all P-Spaces Viens: Wt canbe 
Shown that 
dH 
are 0 : 1 Oms6) 


However, by coarse-graining (i.e. averaging) over cells in 
[T-space of size AT, a new quantity 6(X,t) may be defined as 
CMO eam Uf otk sc yd en (10.37) 
AL 
where AT includes the point X. This new function does 


yield an H-theorem of sorts. 
Defining a coarse-grained H-quantity by 
H(t) = f o(K,t)inp( Kt) dog 
Bt) al plXst yim Oy scod (10.38) 
iy 
gives AGE) shel (Ht) (10.39) 


for all times. This can be proven using the mathematical 
result that, given any two functions peat) and p5(X,t) 


normalized such that 


J 0 (Kt) dM =a) go kat )dim dt (10.40) 
ple ik 
then, 
fo, Ino, donk seated (10.41) 
Tr le 


where the equality holds only for p,=p, (for a proof, see 


Isihara [25]). Upon noting that 
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lode = Pode te om (10.42) 
lie . 
the result (10.39) follows immediately. 


If then an initial fine-grained distribution le) 


is chosen constant over each of the small cells, then 
H(o) = H(o) ; (10.43) 
Noting that #(t) = H(0) = #(0) gives 
H(o) 3 H(t) (fis. (10.44) 


which is a generalized H#-theorem. Gibbs argued that an 


initial distribution would generally spread out in a 


highly complex manner throughout the entire I[-space, forming 


long "filaments" of density pop. He believed that eventually 
these filaments would fill the entire available region of 
T-space with a constant average density p, corresponding to 
equilibrium. However, this is not proven and it is not 


even true generally that 


(10245) 


UN 
© 


Such a method of deriving an H-theorem seems to be a 
mathematical construction and requires some physical 


justification. The usual justification is that only 


coarse-grained quantities of some sort are measured. nis 


is a valid explanation of irreversibility only provided 


PiatudtetSaampossible. to extract or use all of the fine- 
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grained information. Although this may seem reasonable 
due to the highly complex nature of the COTresiae1 ons . 
Blatt [35] has argued that it is not necessary to 
actually measure the fine-grained information to 
demonstrate its existence. He gives an illustrative 
example of a spin system which is analagous to the time- 
reversal gedanken experiment of Loschmidt (cf. Hahn [41]). 
Blatt’s system, which occurs in nuclear magnetic 
resonance studies; consists of’ a° large number of* magnetic 
dipoles, associated with spins, in a uniform external 
magnetic field ihe. The magnetic moments are normally 
aligned parallel to HPA AtEt=O03 an’ Oscr i tating magnetic 
field nye) is applied to the sample at right angles to A, 
and°at’the Larmor precession frequency. This perturbation 
is applied quickly enough and for just long enough that its 
net effect is to align all the moments in the same 
direction in the plane perpendicular to hag When the 
perunre lig field is removed, the moments all precess in 
the external field at their respective Larmor frequencies. 
Due to small inhomogeneities in Ms Eres cm ny etoenG) eS mane 
Slightly different and, as a result, the various moments 
rapidly get out of phase. This decay of alignment after 


the removal of H(t) is observed by measuring the 


magnetization of the sample. When tne spins are aligned, 


there is a net magnetization which precesses at the Larmor 


frequency and which is observed to decay rapidly, in a 
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time ti» as the spins become unaligned. Thus, the spin 
System appears to decay irreversibly to equilibrium in 

a time t. If, however, at a time to>>t,, another pulse 
of the same magnitude and direction as Hy (t) is applied 
for twice the duration of H(t), the neti effecteis tte 
reflect all the spins about a plane parallel. to tie. This 
is directly analogous to reversing all the velocities in 

a system of particles. The correlations between the 
Slightly differing precession frequencies and the 
precession angles then result in the spins realigning 
Ronee Pues at a time Zt. and giving a measurable peak in 
the magnetization. If the perturbing pulse is reapplied 
at intervals ety apart, the spins repeatedly realign to 
give more peaks in magnetization. These peaks, however, 
decrease in magnitude since some of the spins interact 
thermally with the lattice, which acts as a thermal 
reservoir,and cease to precess in the plane of H(t). 
Eventually; in.a time t; this external interaction 
destroys all correlations and the system does not show any 
more magnetization peaks. Thus, the true irreversible 
behavior occurs over a time t governed by the interaction 
of the system with its surroundings. The system can reach 
a quasi-equilibrium in a time t, much shorter than t. This 


t. is a time in which the correlations become so complex 


] 
that the usual macroscopic measurements cannot detect 


them. These correlations are still present and can be 
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determined from fine-grained measurements or may be seen in 
the evolution of the time-reversed state away from apparent 
equilibrium. 

These conclusions may be carried over to general 
thermodynamical systems. Starting from a non-equilibrium 
initial distribution, a system will rapidly evolve, via 
its own dynamics, to a quasi-equilibrium state in which 
the measured macroscopic parameters of the system have 
their equilibrium values but in which there are some 
quantities which are far from equilibrium. In practice, 
these far-from-equilibrium quantities will involve complex 
correlations-and will seldom, if ever, be measured. Thus, 
Eve distributvon.funcetion.of an, isolated system wi lbushow 
irreversible evolution to an apparent equilibrium but, 
gee ctostnesinability.of,an.isolated system tos forget; 
Piosis son y,.through.external.~interactions that .atrue 
equilibrium may be attained. This process will generally 
take longer than the time period for the attainment of the 
above quasi-equilibrium. 

Although these ideas form a more or less 
consistent interpretation of irreversibility via statistical 
distribution functions, the comments of Chapter VIII 


regarding the manner in which statistical considerations 


are introduced are still valid. Although the introduction 


of continuous distribution functions may be accepted as a 


fundamental postulate of non-equilibrium statistical 
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mechanics, this is somewhat unsatisfactory in view of the 
lack of any non-equilibrium analogue of the ergodic 
theorem to connect the distribution Function (or ensemble) 
averages to the "real life" observations on Single systems, 

As discussed in Chapter VIII, the introduction 
of statistical ideas may be regarded as necessary in order 
to take into account the interaction of a system with its 
Surroundings, It is consistent with the usual ideas of a 
thermal reservoir to assume that interaction with the 
System does not change the properties of the reservoir in 
any measurable way, Thus, information may be transferred 
to the reservoir, causing a net loss of information from 
the system, This allows the system to evolve to a true 
equilibrium in a manner that is not possible for isolated 
Systems. This may be regarded as a random thermal 
interaction which acts to destroy the fine-grained 
correlations present in an isolated system. It should be 
remembered that this interaction is truly random only for 
times much less than the Poincaré recurrence time of the 
composite system; however, this time may be made as long 
as desired by considering a large thermal reservoir, 

This discussion agrees with Blatt's analysis 
of spin-echo experiments. Blatt analyses the particle in 
a box model with a thermal interaction, represented by a 
random "thermal" velocity of the walls. This model has 


since been studied in more detail by Kreuzer and Teshima 
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[38]. Blatt concludes that the System has two time scales 
associated with the thermal interaction. In the shorter 
time Ty> the random influence of the walls has destroyed 
the detailed information in the system and, in the larger 
time To» the thermal interaction has exchanged enough 
energy between the particles and the walls to bring the 
System into thermal equilibrium with the walls. This 

time T5 corresponds to the third time scale of Bogolyubov 
in which the system goes to complete equilibrium. However, 
pl atty si time Ty does not correspond to Bogolyubov's time 
scale for the decay of correlations since there are no 
interparticle interactions to cause such a decay. Neither 
is there a kinetic stage in this model because of this lack 
of interactions. Instead, the separation between Blatt's 
two time scales depends upon the dynamics of the wall- 
particle collisions. (specifically °upon*®the: ratiovof* the 
mass of a particle to the mass of a constituent of the 
wall) and is hot? fundamental as“are the’ time*sScales*or 
Bogolyubov. 

It would seem that there are some essential 
features missing in Blatt's model. Some of these are due 
to the fact that the model contains no interactions so a 
particle must collide with the walls several times in 
order to have its velocity randomized. This leads to a 
time scale for relaxations which is much longer than 


expected. Although expdticitly adding such an interparticle 
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interaction would allow sharing of thermal energy and hence 
a randomization of the system in a shorter time, of order of 
the mean time between collisions, this would render explicit 
solutions impossible. The lack of interparticle collisions 
also leads to another unphysical feature of the model, 

mist noticed by Kreuzer and Teshima [38]. (That is, as 

time progresses, the particles spend most of their time 

mm states of very low velocity resulting from collisions 
with the wall which nearly stop the particles. Thus, 
following the evolution of the system for large times 

rather than for large numbers of collisions does not yield 
an evolution to equilibrium between the particles and the 
walls. This feature could be remedied either by an 
artificial restriction which would exclude such collisions 
or by a more detailed analysis of the dynamics of wall- 
Particle collisions. However, such a model would sti11 

not show the behavior predicted by Bogolyubov's analysis. 

It is obvious that such a model (corresponding to 
an ideal gas) cannot show distinguishable time scales for 
evolution but will simply show a complete randomization 
of each particle's motion in a single time tp. 

However, even though interactions are necessary 
to have evolution and randomization in the time scales 
introduced by Bogolyubov, the thermal interaction is seen 
to provide a suitable mechanism to convert a quasi- 


equilibrium state into a true equilibrium one and it is 
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plausible that the effect of interparticle collisions would 


be to greatly accelerate this randomization. 


§10.3 Quantum Systems and Master Equations 

In general, the introduction of quantum mechanics 
does not significantly change the problem of irreversibility. 
post of the diffictwihties of the classicat theory have 
direct analogues in quantum mechanics. The quantum version 
of the Liouville equation (von Neumann equation) is time- 
reversal invariant and has an interpretation in terms of 
ensembles similar to that of its classical counterpart. 


The von Neumann equation may be written as 


oe iN. 
stor ag tied (10.46) 


and may be found either from the correspondence 
{Joga [,] between classical and quantum mechanics or 
directly from the définition of p in Chapter VIII using 


the Schrédinger equation. 


In quantum*statistics, there have been several 
attempts to derive a “master equation" to describe the time 
evolution of statistical quantities. If a system is 
described by a Hamiltonian H = ils tot where Hy describes 


the isolated system and H. describes an interaction which 
causes transitions between eigenstates of H), then, in the 
notation of Chapter VIII, 


> > = k > > 
WE (Ry yee okyoty) = Bey lty) eq (Xyo-++2ky) (10.47) 
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where k denotes the aa member of an ensemble and the >, 


dare’ a complete set of eigenstates of Ho: Thew,= trom 


quantum mechanics, it is known that 


k z k 
Deedes ape Umi tst de (to )o, 
= 5 ok tyg (10.48) 
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where U is the unitary time development operator. Thus, 


k a , k 
c(t) = : Ur mitesty ie (t,) (10.49) 
and 
k* k = k ay 
a (t)c (t) = ue Uitte Vorbindeteteucah te) Sjucon (10: 50)) 


Upon averaging over the N members of an ensemble, 
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At this point, the assumption of random phases 
feomade. [his assumption, justified by the impossitoijary 
of measuring the phases associated with the wave functions 


of the members of the ensemble, asserts that 
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This assumption is an initial condition for Pa; and plays 
a role similar to the assumption that the fine-grained 
distribution is initially uniformly spread over several 
cells in [T-space in the discussion of classical coarse- 


graining. Under this assumption, 


, 
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Writing 


nq tet) | = Ay ft, At) (10.54) 


where At = t-t) and Ana is then the probability of a 
eeansitvon’from’a state i to a state 'n in the interval At. 
Letting P(t) denote the probability that a system is in 


State i at time t gives 


(ts, Adee ace (10.55) 
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That this expression contains a built in irreversibility 
may be shown as follows. From the interpretation of the 


Res as transition probabilities, it is obvious that 


ae ulated Ball OS oT (10.56) 
i 

and that Qui. he een Wl : CTO Sit) 

If the inverse of the matrix eee exists, then 


-1 
PaCS) = 2 As P(t +t) : (10.58) 
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moeancverpreted aS transition probabilities. The origin 


Srethisyirreversibility is the assumption that, at to the 


density matrix is diagonal. Then, unless |U ie 5 


ni nie 


TOY tat, there will be some off-diagonal elements in 
p,;(t). PAS. TOL t>t); no simple equation involving only 
the transition probabilities between states can be valid. 


Starting from a diagonal oF Goes itis possibpie 


J 
to prove a type of H-theorem, known as Klein's lemma. 


jo do so, define 
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Due to the inequality 
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was used. 


H(t +At) 2 Bets) ? (10265) 


This H-theorem results from the spreading of 
the density matrix away from the diagonal form which it 
had at to: Even with this initial condition, this does 
fotsimply a monotonic decay of H(t), since, for coe 
p;5(t) is no longer diagonal and eqn. (10.59) no longer 
holds. the "master equation" as derived by Paull, assumes 
matt 10.59) is Valid at all times: “On this “basac, ac can 
be shown that #(t) decays monotonically to an equilibrium 
value. However, this ignores the non-diagonal part of PG; 
and may be regarded as analogous to the Stosszahlansatz 
used in deriving classical kinetic equations. 

The relationship (10.65) is more fundamental 
since it assumes diagonality only at an initial instant. 


Although the weak nature of this H-theorem and its 
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derivation from an initial condition on P.. are Suggestive 


J 
of the classical coarse-grained H-theorem, no coarse- 
graining procedure was introduced in deriving (10.65). 
his ;2-theorem,has,no,classical analogue... Thisnis a 
Befilection of the factuthat » p,4!no.. iS snOt,~thestrace 
of any operator and hence ee dependent. Thus, 
except at the instant when Pa; kS adhagonal seit ¢does-not 
represent an observable. Therefore, this H-theorem does 
not provide an explanation of observed macroscopic 
Trreversibility. 

In order to remove this objection, it is 


necessary to find the conditions under which Pa; may be 


J 
regarded as diagonal. By considering the distinction 
between macroscopic and microscopic operators, it is 
possible to perform a quantum coarse-graining procedure 
and, from this, to derive a valid H#-theorem (cf. Jancel 
[42]). 


Consider two quantum observables A and B. If 


these do not commute, 
AAAB > yI TABI (10.66) 


where the bar denotes the quantum mechanical average. 
However, all the macroscopic observables can be measured 
simultaneously, so it is necessary to construct commuting 


macroscopic observables corresponding to the microscopic 


Observables A and B. 
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To see how to do this, consider the energy of a 
system. A macroscopic measurement of £ will, in general, 
have an experimental uncertainty SE. Fora large system, 
SE will be much larger than the separation between the 
eigenvalues E. of the Hamiltonian, H. Thus, a macroscopic 
measurement of E will not distinguish between eigenvalues 
of H, but only between groups of eigenvalues of nearly the 
Same energy. Thus, one is led to introduce cells ef) of 


size SE and a macroscopic energy operator Hy defined by 


Ho = re pla) (10.67) 
M ae ia 


where on is the average energy in the cell e () and where 


p (a) Ts ‘the projection’ operator for’ cell ata), defined by 


S 
eee: P. (10.68) 
— a . 


Piexe e is the projection operator for the eigenvalue 

E. in the cell e (a) and where S(a) is the number of eigen- 
Values in that cell. Thus, the macroscopic energy operator 
has a greater degeneracy for each macroscopic energy 


eigenvalue Ey than does the operator H. 


In the energy representation, both H and Hy are 
diagonal, with eigenvalues E. and = respectively. Consider 
now another microscopic operator A which does not commute 


with H. Then, in the same representation, 


[A He = (E,-E,)A,; ~u AEAA : (10.69) 
a Ty 
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The macroscopic measurements Satisfy SES>KE vandecA>sAhs so 
S6ESA >> AEAA ; (10.70) 


Taking E,-E, vote eqn. (10,69) gives 


SEA, << SEGA ROO) 
or Ay; << OA (1.0. 72) 
for E,7E, Se : (10573) 


Thus, matrix elements Aaj corresponding to energy differences 
greater than S6E can be neglected. This means that all non- 
negligible elements of As j are grouped in a. band along the 
diagonal which is narrow compared to the size of the 

cells eo), 

Dropping negligible elements, a macroscopic 
operator Ay iseconstructedawhicheconsists ofsagsed oF 
submatrices each corresponding to a cell elt) This 
Operator commutes with Hy and so the two may be 
simultaneously diagonalized. Continuing in this manner 
govaeotheraoperators(B eCovetca,vithdsrpossible fo 
construct a set of commuting macroscopic observables which 
may all be diagonalized in a representation in which H, is 
diagonal. This is possible because of the coarse-grained 
nature of macroscopic observations. 


In order to derive an H-theorem, define a 


ae (a) 
coarse-grained probability density OM, by averaging p,, 
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iss) are 1 ( 
ae a Sa Sim ab Pas (10.74) 
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where Sat x Ps. Vs the Statistical’ welgnt on cel e (a). 


i=] 
Define an H-quantity by 


H(t) = Tr(pt) ino h®) 


ayy oul Me . (10.75) 


Then, in a manner similar to the derivation of eqn. (10.65), 


EE may be shown that 
oe ey eon (10.76) 


where it has been assumed that at t=0, the fine-grained 


quantity pues is equal to the coarse-grained quantity 

of) . This coarse-grained H-theorem now has some physical 
Bearing since, by defining appropriate macroscopic 
aperatonrs {sit iwasi posstbilemto have ph? diagonal in a 

Diastiss tmiwhich all ‘thewother “macroscopic observables were 
diagonal and hence to prove an H-theorem for a quantity 


Tr (ph) Tn p (+) ) which can represent an observable quantity 


Since it is basis independent. 
Thus, it seems that there are no fundamental 
differences introduced into discussions of irreversibility 


by quantum mechanics. Although the details may be differ- 


ent, the same difficulties occur in both the classical and 
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quantum cases and the interpretations of results are 
Sault ls 1a. . 

In conclusion, it has been shown that if 
statistical considerations are introduced into the initial 
conditions of an isolated system, the Liouville equation 
describes irreversible evolution of the distribution 
function. However, the distribution function of an 
isolated system can never reach a true equilibrium, 
sce .all,.of \the information .about .correlations is, retained. 
If observations are restricted to ones that do not involve 
all the correlations, the system may reach a quasi- 
equilibrium. Even though some of the measured quantities 
in such an evolution may evolve monotonically to their 
equilibrium values, it will be possible at all times to 
find some usually complex quantities which are far from 
their equilibrium values. The fact that this is only a 
Siatistical irreversibility is obvious from the fact that 
a single isolated system must exhibit both fluctuations 
and a Poincaré cycle, while a continuous probability 
distribution may have neither. Unfortunately, there is no 
proof of the equivalence of ensemble averages and 
time averages for an isolated non-equilibrium system, so 
H-theorems which are based on continuous distributions, 
when applied to single systems, can yield only weak 


statements. Such an #-theorem might say that a single 
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system will probably evolve to a state in which the 
measured, macroscopic parameters will approach their 
equilibrium. values. Just how probable this is and the 
precise time scales and nature of the approach to 
equilibrium depends upon the dynamics of the system. 
This, however, is outside the range of purely 
Statistical considerations. It seems that, although for 


short times and limited observations, the distinction 


between equilibrium and quasi-equilibrium is unimportant, 


the most satisfactory way in which to allow the 
Petablishment of a true equilibrium is via an external 


interaction. 
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CHAPTER XI 
RESPONSE OF QUANTUM SYSTEMS TO MECHANICAL PERTURBATIONS 


§11.1 Response Theory Formalism 

In quantum statistical mechanics, there is one 
class of non-equilibrium processes which are of great 
interest and for which formal solutions are easily 
obtained. These are the processes in which the deviation 
from equilibrium is due to an external perturbation which 
can be described by a term in the Hamiltonian. This 
includes a wide variety of important physical processes. 
For example, the Etec rt ea currents in a system acted on 
Dy an external electrical field or the magnetization in an 
external magnetic field are commonly treated Ln. this way. 
However, more general external perturbations, such as 
thermal interactions, cannot be described by a Hamiltonian 
and so cannot be treated. It is also obvious that this 
formalism does not describe or explain the irreversible 
evolution towards equilibrium discussed in the previous 
chapter, since the system is maintained in a non-equilibrium 
state by the application of an external perturbation. 

Although the formalism of this chapter is 
usually applied to transport processes and then only in 
the lowest order (linear response), actually quite a large 


range of situations may be treated. In particular, the 
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Systems which can be described in this way have a Hamiltonian 


of the form 


pesell ae Uy GR) 


where HG is the total Hamiltonian of the isolated system 
and He is the time-dependent Hamiltonian of the interaction 
between the external perturbation and the original system. 
The theory of linear response was derived and applied by 
Several authors ,(¢f.*Kubo [43] ,«Nakano [44]) and the 
resulting formulae are commonly referred to as Kubo 
formulae. 

Following Kubo, the perturbing Hamiltonian will 
be written as 


Ht = -u F(t)A (11-2) 


where A is a Schrédinger operator, uw is a coupling constant, 
and F(t) isa c-number function of time. The perturbation 


is assumed to be turned on at some finite time so 


F(t) ea Oak oe (iesap 


Starting from some initial distribution 


Po = o(t=-0), the evolution of p is governed by the 
equation 
i+ eo =| feel Pega ape 22 te weet) TAyed oy Garza) 


Since it is only the response of the system to the 


perturbation and not the detailed dynamics which is of 
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interest, it will be assumed that the system is initially 
in a time-independent state. This means that Birtles: = 0 
and Py will usually be chosen as a canonical distribution. 
To“simplify eqn. (11.4) 3} convert’ all ‘operators 
ro the mteraction picture: This is'done=by* defining’ an 
interaction picture operator By (t) corresponding to an 


arbitrary Schrddinger operator B by 


Heat ribo a 
1 aperontepigl 
Bait) =e 4) Be ees) 
Eqn. (11.4) then becomes 
do,(t) a 
in —S— = -uF(t)[A,(t),0)(t)] ieee 


which can be written as an integral equation, 


and, since [oH y=70*, 
py baa ae (Ties 


Thus, iterating eqn. (11.7) gives (after transforming back 


from the interaction picture) 
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This is the quantum analogue of eqn. (9.63) and 
is an exact formal solution. However, for increasing times, 
more and more terms must be kept to have an accurate 
Express?on'for*p(t)! "Its practical value is also limited 


Beeetne necessity of exactly calculating terms of the form 


5 L 
£0 
ic ane 
{e [A,(t,) [A (t,),...,[A,;(t,) so 5]... Je te 2 lleeat 05) 
Even in the lowest order approximation, 
Het Heat 
— e0 Ss) 
: u een a Uae 
p(t) = Po ie Sail dt, te F(t, )LA;(t,),0 Je by Cilaa In) 


getting an explicit solution would be at least as complicated 
as solving for the entire evolution of the unperturbed 
System, since Ho describes the entire dynamics of the 
unperturbed system. 

However, it is possible to derive important and 
quite general relations for the response of a system from 
this formalism. Examples of such relations, obtainab'e 
from linear response, are Onsagzr relations and fluctua- 
tion-dissipation relations. Before deriving these, some 
discussion of the validity and applicability of the 
formalism and of the conditions under which the series 
(11.9) may legitimately truncated, as in eqn. (11.11), 
is in order. 

First, however, note that the above non-linear 


response theory is exactly equivalent to the perturbation 
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theory familiar from many-body or quantum field theory. 
In those theories, a perturbation expansion is found for 
the unitary time development operator U(t,t,). This 


expansion is usually written as 


nce q peace oh 
at a hee ; 
U(t.t,) =e sb =) f dt, dt, f dt Hy (t,) 
tO os 0 
Hoot 
ia 
H(t, Je lee) 


In many-body theory, the usual interpretation is that Us 
describes a system of free particles and the perturbation 

H' is the interaction between particles. There is nothing, 
however, in the derivation of eqn. (11.12) which requires 
Ents and, if Ho is the total Hamiltonian of the unperturbed 
System and H'is the Hamiltonian of the external ee ihasiin 


then it can be shown that 


o(t) = U(t,-»)p, UT(t,-©) (11.13) 


is exactly the same as the response theory expression 
(11.9) for p(t) (cf. Bernard and Callen [45]). This 
equivalence is mentioned merely to emphasize that the 
linear and non-linear response theory is a purely 


dynamical perturbation theory even though it is applied 


to a statistical operator. 
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B1li2+,Validity of Response Theory 

From the derivation of the expansion (11.9) for 
p(t), it is clear that the theory describes a system which 
Pswinitially, atesome time in, the distant past,,in 
equilibrium. This may be achieved, for example, by 
putting the system in contact with a thermal reservoir. 
Then, at some past time, the system is isolated from the 
reservoir, a perturbation Hy is turned on, and the dyna- 
Bacolmevolutionyofyoléiais-given:by~(11.9)..sThussvin 
analysing the validity of linear or of non-linear response 
aaa there are two important questions. First, under 
what conditions is the isolated system of the perturbation 
theory a good approximation to the physically realizable 
Situation? Secondly, for what conditions is the linear 
response expression (11.11) a sufficient approximation 
popthesexactwexpness! onelil.9)? 

In answer to the first question, it would seem 
that, in many physical systems, the thermal and other 
non-Hamiltonian interactions are vital. For example, in 
order to calculate the electrical conductivity of a metal 
at temperature T, it might seem reasonable to apply the 
preceding formalism. However, if the system is considered 
long after the applied field is shut off, there are two 
different situations. In the physically realizable: system, 
the metal has returned to equilibrium at the same tempera-~- 


ture T due to thermal interactions. However, in the 
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isolated system to which the above response theory applies, 
the system will, for example, have absorbed energy in the 
form of Joule heating and so will not return to temperature 
T without the thermal interaction. Note that this is a 
macroscopic effect and that the microscopic motion will be 
drastically affected by even a very small thermal 
interaction. 

Also, in such a conductivity experiment, another 
fundamental thermal interaction is present since, in order 
to maintain a steady current through the system, electrons 
are supplied from a battery at one end and are removed at 
the other. In order that this not significantly affect 
the results, it is necessary that the electrons in the 
system always have essentially the same distribution as 
enosemexternally supplied.w) ‘This. further restricts. the 
validity of response theory. 

tv isaveryramportant, tonnotey thatedtris only 
in the linear response term that the effects of thermal 
and of mechanical perturbations are independent. Thus, 
even if the thermal perturbations are such that they 
average out to give an insignificant contribution to the 
linear response, they may still interfere with the 


mechanical non-linear response. 


This analysis is rather pessimistic and it is 


often possible to replace the physical system with an 


idealized isolated system to which response theory applies 
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and which would be expected to show the same general 
reatures as the physical system. With such a System, the 
linear mechanical response may be calculated and, from 
experience, it is expected that the effect of small 
thermal fluctuations upon the conductivities would be 
small. For example, for electrical conductivity, the 

need for exchanging thermal electrons can be eliminated by 
considering a toroidal conductor and by adiabatically 
Supplying a tangential electric field by changing the 
magnetic flux through the center of the toroid. In such 

a situation, it is reasonable to assume that the resultant 
conductivities are very nearly the same as for the usual 
conductivity experiments. 

Although it could be argued that the isolated 
system described above could never reach a steady state due 
to the previously mentioned Joule heating effect, it can 
be shown that the first term in the Joule heating is 
quadratic in the applied field and hence, for small 
fields, it is expected that the system should reach a 
steady state long before Joule heating becomes important. 

Thus’, ‘althoudgh it tas wet been #proeven. at ors 
reasonable to expect that the linear response expressions 
are valid for systems which can be replaced by idealized 


1so0hated "systems. “This “Ts not true of the higher order 


responses and, even for linear response, is only true to 
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the extent that the macroscopic response is insensitive to 
thermal perturbations. Note that certain attempts to 
explicitly take into account the thermal perturbations, 
for example by introducing a time-dependent temperature, 
are not sufficient since they only account for a single 
macroscopic effect and not for the complex microscopic 
ereects« 

Concerning the question as to the range in which 
the linear approximation is sufficient, van Kampen [46] has 
given some arguments and estimates. Essentially, he 
claims that linear response is valid only for applied 
fields so small as to be physically unrealistic and that 
the observed linearity of responses, such as electrical 
currents, is the result of a complex average behavior and 
not of the linearization of the equation of motion for p(t). 

To: justify this, he uses an example of a -classi- 
Calesystemtofoeléectrons: which’ are scatterednbysagsingle 
impurity. If, as van Kampen does, one chooses a diameter 
of ine meters for the impurity and an effective mass of 
Mare kilograms for the electrons, and agrees with his 
argument that, for linear response theory to be valid, the 
displacement of each electron's position from the position 
it would have in the absence of a perturbation must be much 


less than the diameter of the impurity, then 


r2e cc 107!® sec* Volt/meter (11.14) 
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Porta Statictélectrie freld ES and for a time t after the 
perturbing field was turned on. This criterion would be 
even more severe in a physical system where there are 
many impurities and where multiple scattering is possible. 
It must be realized that this criterion gives the range 
for which all phenomena, including transient responses, 
are linear in the app hred field tat "eime "ts? Brrssensuness 
Por exanple; that if ‘an “isolated conductor is placed 
between the plates of a capacitor and, at to a constant 
electric field is turned on, then, for the time given by 
ormterion (TP. 14)) all ‘the "motions “are linear ‘in “the "ffeld 
strength EO: This *time “s'<not! a macroscopic “time, "sch “as 
the time required to measure a current, as van Kampen 
argues, but rather is some time less than the microscopic 
relaxation time in which the charges redistribute themselves 
on the conductor and counterbalance the applied field. 
Thus, van Kampen's criterion (11.14) is seen as a 
restriction on the time for which the transient response 
is linear, rather than a restriction on the strength of 
fields for which linear response is valid at some time t. 
It is now seen that van Kampen's criterion and the time 
dependent response theory have nothing to do with steady 
State phenomena. 

It is possible, however, to deal with steady 
state responses by assuming that the external field is 


switched on infinitely slowly. If the system is observed 
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after the interaction reaches full Strength senene i to1s 
expected that all transient phenomena will have died out 
and that only the steady state currents will remain. 
Since the perturbation will have acted on the system with 
em ices strength for ah infinite time. the perturbed 
and unperturbed systems will have evolved to entirely 
different states and so no finite number of terms in (11.9) 
ean completely determine o(t). The assertion that the 
actual linear steady state response can be determined from 
linear response theory depends critically upon the fact 
that the final state is time-independent. This can most 
easily be seen by switching on the interaction adiabatically, 
but it would be expected that the steady state response 
would be independent of the particular manner in which the 
interaction was turned on. 

This situation may be regarded as analogous to 
the situation in elementary perturbation theory in which 
it} 1S Often possible to*’ calculate time independent perturbed 
quantities even though there is no hope of finding the 
exact time dependent evolution except for very short times. 
For example, in quantum systems subjected to a periodic 
disturbance, Fermi's Golden Rule predicts constant 
transition rates long after the perturbation is switched on, 
analogous to the steady currents of linear response. 

The distinction between time dependent and steady 


state phenomena may be clarified by considering the general 
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linear response expression for the response of an operator 
B to a perturbation -yF(t)A. The statistical average 


<B(t)> of B is given by 


Soto = irlo( te] 
t mesa te ;_0 
Er fo g8]=te) Tebf tdtve 


= © 


SES), 


This may be written, defining <B> = Tr[p B] and using the 


cyclic invariance of the trace, as 
t 
a H_ = 
Bat) > <= Soe ae (.) f dt, F(t,)Tr{[A,o, JB, (t t, )} AGS eai 63) 


= 0O 


To study transient response, let F(t) be a step 


function applied at t=t)- Then, 


t 
<B(t)> = <B> 4 (ay) f dt, Tr{[A,o,]B,(t-t,)} 
ty 
tte 
= <B>) -(-5) f dtTr{[A,o,]8,(t)} 
O 
=PcE> to, (t-to) (lien 


The corresponding non-linear expansion may be 


written as 


2 
<Biitjo.= <B>, + yo, (t-ty) at o(t-t)) ee Chl se) 


cnergl 0 
SS via | ts ae 
4 7 ¥ ay Vn “ee P 


A ee 
ee ao 
a 


shag Oh in Ai ri i 
eer bord 
a 


where all the coefficients Oo (t-t ot are functions of time, 
Bbut=are independent oT ul" -For-this*transienteresponse, 
the non linear terms may be large or may average to a 
negt?tgible' quantity for different times: In this case, 
the only estimate for the validity of response theory is 
One in the spirit of van Kampen. 

The situation is quite different in the case of 
adiabatic switching. Adiabatic switching means that the 


interaction is turned on infinitely slowly so that 


St 


Pies lige. ec . GL 1a.19)} 
E>0 
Thus, 
: Et 
€B-tizesdsBoentelimic( sm) J dt,e 'Tr{[Aso, 1B, (t-ty)} 
€>0 at, 
= <B> tim, (-He)e°"fdeTr{LA,o,]By(t)e "3 
EO x 
= <B>_ + yo : (12205) 
fe) ] 
where a 
gj pestlelaing ef ty fodcTrubAsprape( emat} (11.21) 
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is independent of t for finite times due to the assumption 
of adiabatic switching. The non-linear terms may be 
written as 
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where all coefficients are independent of t and of u and 
depend, for a given perturbation operator A, only upon the 
properties of the unperturbed system. Thus, the adiabatic 
Switching has resulted in a unique, time independent 

power series in yp for the steady state response of the 
System. This power series is exact for any value of u and 
the non-linearity as a function of yw is merely a measure of 
the convergence of the series and not of the validity of a 
particular term of the expansion. 

This, of course, does not give any criterion for 
the range of applied fieids for which the linear response 
dominates the expansion (11.22) and this would depend upon 
the dynamics of the system. Since eqn. (11.22) is exact 
for steady states, it must agree with the true response. 
Thus,,,for,steady states,-the range of. validity .of .linear 
response theory is the same as the range of validity of the 
linear phenomenological laws. However, there still 
remains the question of whether the true phenomenological 
laws are the ones actually observed in the laboratory. 

It is possible to imagine some sort of guasi-linearity 
holding only for reasonably large and measurable values of 

u and with true linearity, as described by linear response 
theory, holding only for values of pu So small that the 
resulting currents are unmeasurable. This is similar to 

the possibility discussed in §3.2 with regard to the Onsager 


reciprocal relations and, as in that ydTSCussiIOnN..| a rigorous 
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justification of the equivalence of linear response 
expressions and the linear phenomenological laws is 
missing. However, the linear nature of the laws within 
the measured range makes such an equivalence reasonable 
and, for particular models, the range of validity might 
be calculated. 

In summary, it appears that van Kampen's 
arguments against linear response theory, although valid 
for transient phenomena, do not affect the validity of the 
steady state expressions. Instead, investigations as to 
the validity of steady state expressions should concentrate 
On the extent to which thermal interactions can be ignored 
in the physical system and upon whether the observed behavior 
is truly linear or merely quasi-linear. The non-linear 
response coefficients are on a much less secure basis 
Since they are directly affected by” the lowest order 


thermal perturbations. 


Giles enpp|icacihons 
As stated before, linear response theory can 
be used to derive Onsager relations and fluctuation 
dissipation theorems. To do this, it is useful to define 
certain operators and to derive certain relationships. 
The perturbing Hamiltonian will be assumed to 


have M separate contributions and will be written as 
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where the A, are the Schrodinger operators. The linear 
Response expression can then be written as 
t Nise ee 
Re Tes eon enone 
] J 


= 00 


(11.24) 


The linear response of a general operator B. can be written 


as 
AB, (t) = <B,(t)> shee 
M t 
] 
- ae 7 )f F j Tri La, Do 1B, 1(t- t,)idt, 
ClMig25) 
; ; BA 
Define a response function o; (t) by 
BA pal 
o; 5(t) - "TH Tr{ LA; 0918, ,(t)} 
oy ee 
eed Tr{p [B;,(t).A, J} (eh 6) 
BA 
and a susceptibility x. jh” w) by 
7 -lwt,-et 
BA ] ] 
eC) = fo, s(t Je dt, (1a 27 3 
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where the factor ane serves to ensure that the integral 


+ 
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and, fora periodic perturbation, 
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The oF5 have certain symmetry properties. 
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(11.38) 


where * denotes complex conjugate, t denotes Hermitian 


conjugate, and where Aas B. have been assumed to be 


Hermitian. 


Also, note thats if time-and all magnetic tjelds 


H, are reversed, the wave functions and operators in the 


position representation go to their complex conjugates. 
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= + 1] depending on whether Bi ie are even or 
odd under time reversal. 


Finadly 2 note: that 
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These symmetry relations are most useful in 


, $ ae 
the case where B, = A.. Then, letting oe Dae ; 
* > > 
o,5(t.H) = 655 (t.H) (ies) 
end 6; 5 (tH) = e436, (t.-Hl) , (11.35) 
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the case where the currents 


derive Onsager relations in 
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These are the Onsager relations. They are based 
on several assumptions which are similar to those required 
forecesimir'’s proof, as presented nes 02 oe oF irs tee, Weis 
assumed that the linear response expressions are the same 


as those observed phenomenological ly (i.e. that no quasi- 
linearity holds). Secondly, it was assumed that the 

Currents considered are the time derivatives of tne "forces". 
Also, in accordance with the earlier discussion of linear 


response theory itself, the system must have a relaxation 
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time much less than the time in which the perturbation is 
turned on. Finally, in order that the linear response 
theory should be a good approximation to the full response, 
une system must be “near” equilibrium. It is “interesting 
that the assumptions needed to derive Onsager relations 
from linear response theory are almost identical to those 
needed for Casimir's proof. Thus, linear response merely 
provides an alternative derivation of Onsager relations 
which does not directly involve thermodynamic concepts 
such as entropy and in which the role of fluctuations is 
hidden in the density operator Po: 

As an example, consider tne case of electrical 


conductrorms* Then’, HY may be written as 
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where ris the position of the ie particle and where e 
is the charge on each of the N particles. then, 
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Therefore, from the general results above, 
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Jace = Re[o, jlo JADE ,(t yn (11.44) 


HO pernodic elecagic frelds.. In cl Vaedeje Ls; has been 


written as Oi; in accordance with common usage. The 


conductivity tensor o., obeys the Onsager relation 
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and is given by the expression 
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For the canonical ensemble, Pp ae ; this can iberwriteen 


in a compact form by using the identity 


B 
-8H -6H AH -H 
[A ;>€ gee ainca °TH, A, Je Odd 


Sih. ae A; (-ifiA) dn Gis aArs) 


where the dot denotes time derivative (cf. Kubo [44] for 


a derivation of this identity). For the canonical ensemble, 
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The form (11.49) is usually referred to as a Kubo formula. 
As a second application of linear response theory, 
a fluctuation dissipation theorem is derived. In its 
conventional form, a fluctuation dissipation theorem 
establishes a relationship between the linear response 
Aq(t) of a system to an external perturbation and the 
equilibrium time correlations <q(o)q(t)>, of the same 
quantity, q. It is, however, more convenient to express 
this as a relationship between the frequency dependent 
response function Xq lw) and the spectral density of 


fluctuations Sg(w). These quantities are defined by 


nq(t) = Re{xg(w)Fo ety, (11.50) 


EOTaperturbations o; the form (11). 29)ssand aby 


Sgw) = +f <qloja(t)>, e'Pat (11.51) 


The original fluctuation dissipation theorem was 
obtained by Nyquist [47] in the case of an electrical 
network. Later, his formula was generalized to other 


systems and a formula was obtained which reduced to his 


formula in the classical limit. 


In order to derive this fluctuation dissipation 
formula from linear response theory, define the analogues 
b 
of Xq and Sqw) y 
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where Q is the quantum operator of the perturbation whose 


response is described by XQ: Then, 
AQ(H) = Retxglo)F, ey (53) 


The quantum equivalent of the autocorrelation function 


<q(o)q(t)>_ is the properly symmetrized product of Q and 


fe) 
Q,(t). That is, consider 


<Q, (0), (t) + Q,(t)Q,(0)>, = 5<00,(t) = QV Gt) Oem sa) 


and define the fluctuation spectrum 


Sq(w) = ~ f y<QQ,(t) + Q,(t)Q> e'Fdt =. (11.55) 
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Calculating XQ from (11.52), in the*same basisjeyie ids 
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Comparing equations (11.58) and (11.57) gives the 
Fluctuation dissipation theorem as derived by Callen and 


Welton [48]: 


Im(xg(w)) (11.59) 


which in the classical (high temperature) limit, Bw-0, 


gives Nyquist's formula 
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This concludes the discussion of linear response 
theory. It should be kept in mind that, although various 
authors have derived linear response expressions for 
non-mechanical perturbations (e.g. diffusion transport 
coefficients), linear response does not provide a general 
method for finding effects due to non-mechanical interac- 
tions. Also, note that no general procedure is available 
for calculating the linear response expressions and that 


the actual calculations can only be carried out for some 


drastically simplified form of Hy 
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CHAPTER XII 
PRIGOGINE THEORY QF IRREVERSIBLE PROCESSES 


cicat. antroduction ana Potent? 41 scattering 

In a series of papers, Prigogine and nis 
collaborators developed a rather different approach to 
non-equilibrium statistical mecnanics (Prigogine and 
Balescu [49] and [50], also Prigogine [51]). Starting 
from the Liouville equation, they obtained equations for 
the Fourier components of tae distribution function. 
These Fourier components have direct interpretations 
ececorrelatrons 1 tne SYStem, Also, the Fourier 
expansion is formally an expansion in tne eigenfunctions 
Of the free particle Liouville operator. There is a 
direct analogy to the Schrodinger equation in quantum 
mechanics and many of tne techniques used in quantum 
mechanics may be applied to the Liouville equation. By 
nutting the Hamiltonian in the form H 5 ie + XV where ile 
is the free particle Hamiltonian and AV describes tie 
interactions, it is possible to associate "matrix elements" 
with the Liouville operator which give rise to transitions 
between different eigenstates of H,. Tnese are states 
of different correlation and thus the Prigogine theory is 
described as a theory of the dynamics of correlations. 


Bisgeetits formalisn 1s conveniently written in terms of 
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of diagrams which represent the different possible 
transitions and which are referred to as representing the 
Creation ; destruction, OVe propagation of correlations. 
By concentrating on "dominant diagrams" On LY el ELLs 
sometimes possible to derive closed equations for certain 
OFethe:. Fourier terms and$to relate these to the usual 
reduced distribution functions. In choosing dominant 
diagrams, an important role is played by the limit hem, 
Q(volume)>+o with N/2 finite and by the limit 20, tom, 
Finally, much of the theory is most clearly and concisely 
formulated by using a resolvent technique to obtain 
iterative equations for the correlations. 

Most of tne specific equations derived from the 
Prigogine theory are obtainable from other formalisms, 
Tiss 1S a reflection of*the fact that the complete 
equations of Prigogine are entirely equivalent to other 
schemes such as the BBGKY theory and Prigogine's choice of 
dominant terms is related to the approximations made in 
other theories. However, as empnasized by Bogolyubov, 
correlations play an extremely important role in 
irreversibility and in the study of kinetic equations, 
Thus, since the theory is explicitly set up to deal with 
correlations, it often gives a simpler formulation of 
assumptions and approximations than is possible in other 
The generalization of the results of the 


theories. 


Prigogine theory to quantum mechanics has been carried 
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Out and presents no essential difficulty (cf. Resibois [52] 


or Prigogine [51]). However, only the classical case 
Hil be treated in thisg thesis. 

FOr thesclassical case, the system's evolution 
is governed by the Liouville equation for the full 


distribution function p(X,t): 
KAR). = LHe s (12.9) 


where X represents the 6N coordinates of the system. 


Using the Liouville operator Z, defined in 89.3 as 


B= T(t, 3 : Cl 22) 
eqn. (12.1) becomes 
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Since L is linear and Hermitian, eqn. (12.3) is analogous 


to the Schrédinger equation 
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so the methods of quantum mechanics are appropriate. 
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The eigenfunctions of Lo are tne functions ¢, defined by 
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Le » = ee p 
These are easily seen to be 
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The coefficients 0, (p) are to be determined by the initial 
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If there is an interaction term AV in the. 
Hamiltonian, then the distribution function may still be 


expanded as 


0 (Fp yt) = 9 ? e a fp, t) (T2132) 


but the coefficients o.(p,t) are no longer independent of 
k 

time. In this case, the Liouville operator may be written 

as 
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so the Liouville equation becomes 
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Inserting the expansion (12.13) for o gives 
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It should be kept in mind that the matrix elements are 


operators. 


The initial values of the py are, giyeneby 
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oly spyoyd (12.19) 


Before-generalizing eqn: *(12.17) to the case of 
more than one particle, consider an example where AV 
mepmesents the effect of an external centralspotential 


V(|r|) on a free particle. Then, 
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where the fact has been used that Y. = Vag for a central 


potential. 
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Eqn. (12.25) can be rewritten as an integral 


equation 
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This equation describes the evolution of all the 
Fourier components. Often, however, only the total 
momentum distribution is of interest and not the local 
inhomogeneities. For example, one might be interested in 
the total number of particles scattered into a particular 


final velocity state. In that case, the quantity of 


interest is the momentum distribution 
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From the iterative nature of tne derivation of 
ednenGl2.33) aas iwelhias fromatheadi seuss ion yok simitar 
expansions in §9.3, it is apparent that this expression 
(ignoring terms of order nigher than 2) is vahndion|l yRaor 
times sufficiently small that tne effect of the potential 
AV upon the distribution function is negligible. Prigogine, 
however, consistently takes the limit t+» while ignoring 


higher order terms (cf. Wu [53]). He justifies this 
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procedure by considering the "weak coupling” limit te, 
A>0 with 5 oH constant. This limit, whatever its physical 
Significance, then allows him to use the asymptotic (t+) 
values of the expressions in eqn. (12.33). He also takes 
the limit Q+© in order to replace the sum over ¢& by an 


integral, using the well known correspondence 
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In Prigogine's treatment of this problem, the various 
limits and integrations are exchanged without any 
justification being given. This, combined with the fact 
that his results are essentially low order perturbation 
theory and are critically dependent upon the weak coupling 
assumption, seems to detract from the rigour and generality 
claimed for his results." Also, Prigogine s tnterpretation 
of his results on the scattering problem (cf. Prigogine 
[54]) can be questioned (cf. Kreuzer and Kurihara [55]) 
since it may be argued that a single potential of finite 
strength in an infinite volume can have only a local 
effect. Thus, in considering the effect of the potential 
upon Babee), which refers to the system as a wnole, the 
effect will be negligible as Q>~. This is seen in the 
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expression (12.33) gives the dominant contribution for 


to, even in the weak coupling himit. 


§12.2 General Theory and Resolvent Formalism 

The main interest in the Prigogine theory, 
however, lies not in the interaction of a single particle 
(or an ideal gas) with an external potential, but rather 
in analysing tne behavior of an interacting system of 
particles. The above results for a single particle are 
easily generalized to the case of N particles. The 


appropriate expansion of p is then 
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where 


Da (— -—2), (12.38) 
op. oP; 


Manipulations similar to those leading to eqn. 


(12.17) give the equation of motion for 0 as 
e are? {k} a 
> F N > P; N = p. 
dp ys pets) 1% k.e—t ae pa Jy 
. K } Ga] 208 m ay jer J 0 
i ws S12 <{k}|6zZ|{k'}>e 
{k } 
LUE pine) (12.39) 
where the matrix elements are given by 
pest |Gkil> = @7' ss. Ve US ERT Yok 
. haled<acni ng NFisitek sk! 
6 6 (1240) 
kK} sk -¢ ke rk +8 


where the potential V(|r at) has been Fourier expanded 


va y if-(R,-F,) 
Vii linet al) es OQ me ape ce (1240) 
g 


In a manner entirely analogous to the derivation 
OfPeqn. (12'33)5 a" perturbation expresston 70m the 
components o ({p},t) may be derived from eqn. (12.40). 
However, a more concise development of the formalism is 
possible by introducing resolvent operators. First, 


however, it is useful to introduce the diagrams correspond- 


ing to the different possible transitions between states of 


different correlations. 
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Note that the matrix element <{k}|6z|{k'}> 


iS non-zero only if 


(12.42) 


That is, wave vectors are conserved in the various 
possible transitions. Thus, a typical matrix element 
would be 


<{k} kj sk, /6z|(k},.-2,k +8 > ; (2 43) 


This element may be pictured as in Figs" l20are?nstandard 
Scarvtrering notation, this would correspond to: Fic, w2eab. 
Since the cases of interest are often those in 
which there are few initial correlations (all or most of 
" the k, are zero), only non-zero wave vectors will be shown 
in the corresponding diagrams. The state with all K, 
zero (denoted by |o>) is said to form a "correlation 
vacuum". 
There are six basic types of diagrams, shown 
if fig. 12.2. Figures (a) and (b) represent the propaga 
tion of correlations from the right to the left, (c) and 
(d) represent the creation of correlations, and (e) and 
(f) represent the destruction of correlations. All 
possible matrix elements can be represented as combinations 
of such "elementary" interaction diagrams. 
In order to derive closed equations for the 


various Prigogine studied the asymptotic dependence 
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of the various diagrams upon N and 2 (in the limit N Qs ,N/Q 
finite). This required an assumption that all distribution 
functions depend only upon the ratio N/Q in this limit. 
Once the asymptotic form of tne various diagrams is 
establisned, one can retain only the dominant diagrams 
to each ‘order in A. Doing this sometimes yields closed 
equations for the coefficients with few non-zero wave 
vectors. However, in order to get convergent results 
when terms of higher order in X are included, one must 
again assume weak coupling, even when only dominant 
diagrams are included. 

A more direct route to the final results of 
Prigogine is via the resolvent formalism, as developed by 
Resibois. To this end, define a resolvent operator R(z), 


corresponding to the Liouville operator, by 

RZ) = (> Ale (12.44) 
where z is a complex variable. From 89.3, 

sity et oleae (12.45) 


Using the Cauchy formula for operators, eqn. (12.45) can 


be written as 
-izt 


o(t) = =z (aratyi2 (0) (12.46) 
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where the contour C is shown in Fed wal ces 
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fignsl223: .,contourghorgintegral (12.46) 
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Since HL HISMNeshi trary ah Singularities of the 
integrand lie on the real axis and therefore tne contour 
ietag. 2.3 encloses all the singularities. 


Using the operator identity 
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Neca 2 a BN Be (12.47) 
for the perturbed and unperturbed resolvents: 

eee ea mearresg i 
and pa! aaydiie( 2) chien eee (12.48) 
gives R(z) = Ree - AR(Z)SLR,(z) : i240) 


This can be iterated to yield the perturbation expansion 


af n 
REZ} i= ere FRalz) L=voeR, ta )d | (12.50) 
n=0 
Next, Fourier expand p(t) as r 
: > > 
1 Keane t. 
Rijn arma edeioriset (12.51) 
{kK} {k} 


where the op (it } in eeqwres (12051) fare novetoebercontused 
sy 
with those in eqn. (12.35). Inserting eqns. (12.50) and 


(12.51) in eqn. (12.46) gives 
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where the matrix elements of 6Z are given by seqn. (12.40) 


and those of ole’? by 


<{K}|Ro(z)|{k'}> = ——— CS) 


The matrix elements of Rae) are referredeto tas propagating 


the correlation state between interactions. 

For example, in the scattering situation described 
ig9.812.1’, the second onder effect of the scattering 
meter tt al represented in eqn. (12.33) corresponds to the 
term 


<o|R SLR éLR, | o> (12.54) 


where tne initial and final states have no correlations. 
This term is associated with the diagram of Fig. 12.4. 
Thesexpression (12.54) iswsarTd™vo.represent the 


lowest order "vacuum-vacuum" transition. 


For the vacuum state |o>, Rez) has a particularly 


simple form and the expression (12.54) can be written as 


1 
<o|R SLR, 5LR, | o> = oe <o|SZR,sL| o> 
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where the operator w(z) defined by eqn. Cliz255 emis 


referred to as the finite frequency collision operator. 
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Fig. 12.4: Lowest order vacuum-vacuum diagram 


Fig. 12.5: Multiple collision diagram 
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The contribution of the term (12.54) to the 


SvorutToOn Of 5 ets given by 


{k 


sy) 


re ae ge i7t i, w(z)p ({B}.t)dz  . (12.56) 
C Zz 


Assuming that y(z) is regular at z=0 and neglecting 


Singularities of w(z), 


T= -a% Sey (z)p (1B,0)1 
BENS 
= x*Eity(o) + $41 Ip, ({83.0) (12.57) 
Z=0 


The *wirst term of ‘CZ. *orows linearly im tine 
and is interpreted as a collision process. Tnus, each of 
these vacuum-vacuum transitions, by introducing a. double 
pole at z=0,, describes a collision process. Similiarlyoea 
destruction or creation term gives a single pole at z=0 
ondsso.yields ia contribution. consent: inetalies ihe. e ion 
the form illustrated in Fig. 12.5 gives a triple pole and 
corresponds to two successive collisions. The terms 
ignered in eqn. (12.57), arising from singularities: of 
oz yeatez720, will, in ‘ceweral:, yield damped oscillatory 
Perms. 

Toy ag eity fa: cheat en understanding of these 
conclusions, it is worthwhile to study the structure of 


w(z) in slightly more detail. From eqn. (T2255)5 
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w(z) = <o|SZR 6z| o> 
==), oy 4016 5% K¥-ks<k ok R K gokceekin ok Gli Pies 
gpa eay [62,5 [RoI |Z, ,| 
Guerdecey| 
and ee eee | (12.59) 
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ee 
ae 

<o|6L; ;|K,-k> 2 go (1260) 


Converting the sum over Kk to an integral by using eqn. 


(12.34) gives } 
lv.| Keak 
Ma QO 3 Le Dea ie (12761) 
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This implies a transition to a thermodynamically large 


system. 


For an interparticle potential of range l/a, 


given by 
Way eon (12.62) 


the Fourier components are 


ee eee (12.63) 
Me Te? (ariky? 


Thus; with this choice of potential, new poles 
appear in the integrand of eqn. (12556)2 the contriou tion 


of these poles to I can be shown to be of the form 
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In this expression, alvi-V,| is of the order of the inverse 
of the collision time for two particles, so the expression 

(12.64) is damped in a time of order of the collision time 

and is unimportant at large times. 

Although it is not proven, it is assumed that 
the general terms in the expression (12.52) have a 
behavior’ sStmitar to that ef thestérm (12.55). If this ds 
SO, it is possible to draw rather general conclusions about 
the important terms in the general case. However, the 
assumptions which must be made restrict the Validity ioFf 
the conclusions. For example, in much of the work of 
Prigogine, Resibois, etc., it is assumed that there are no 
long range correlations or that the system interacts via 
essentially instand#aneous” collisions. sUnfortunately. at7ts 
not clear what the explicit restrictions are upon the 
system in order to justify the very general assumptions 
which Prigogine makes. 

In order to study the general evolution, the 
various terms are separated into creation, destruction, and 
diagonal terms. This separation 1S:indicated by “the study 
of simple terms such as (12.53) and is a formal one in that 


explicit demonstrations that such a separation is a 


fundamental one are lacking. 
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The general equation for Py is 


a ] -j * ~ 
4 UO) res oa N7E a {<0| Rg L-A8ZRgI"] o> ( (8) .0) 
Cc 
# ek) <0 RED-AGER TK }>0 (26040) fel) semalcmos. 
{k'}#0 tk'} 


This has been separated into a "diagonal" vacuum-vacuum 
term and a "destruction" term. Next, introduce the 
following operators and symbols: 

ay an irreducible diagonal diagram 


| <0[-A6LL-R ASL] |0>, 
| 


(12266) 
where "irr" indicates that there are no intermediate 
vacuum states, and 


(2) an irreducible destruction diagram 


D (ee = §2 0) TeAGER a eka 
{k"} m=] 


The complete diagonal contribution can be 


t 1286 7,) 


expressed in terms of the irreducible diagonal diagram as 


-ijzt @~ n Es 
3 12.68 
oy 2 : 2 CHT p,({p}.0)dz ( ) 
C 


This is simply a reordering of the terms in eqn. (12.65) 


in a manner familiar from field theoretical perturbation 


theory. 
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Considering the complete destruction term 


allows one to write eqn. (12.65) as 


QUID) {o.({p}.,0) + y 
C4 FD 3 {K'}#0 


<{f 0 ({p} ,0)}dz (12.69) 
{Ki} 


where the abbreviation 


Ea ({p} 0) (12.71) 


YesD (Gz) 
{k'}#0 {k'} ' on 


was introduced. 


Differentiating eqn. (12.70) with respect to 


time gives 
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C12. 72) 


If the Laplace transforms FT (t) and 6 ({P} +z) are defined 


by 
F(t) = - de fe 7* F"(z)az (12.73) 
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and ec tae = Gen ape lae (12.74) 
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Using the convolution theorem for Laplace transforms and 
denoting the Laplace transform of v'(z) DY sGUt)TAtnis 


can be written as 


dp ,(t) 
ee rruepst ube) "a IaSinlat Gt ode ae (12.76) 


This is the general evolution equation of the 
system. It is obviously non-Markoffian due to the 
presence of an integral term in eqn. (12.76). The term 
F(t) can be said to represent the effect of the initial 
correlations on Po° In simple cases, where there are no 
hong yange forces or correlations, 1 1S anticipated “that 
this term will decay in a time of the order of the 
collision time and thus can be neglected at large times. 

The non-Markoffian integral term depends only 
upon the values of p) and represents the effect jog tne 
diagonal transitions with an arbitrary number of 
intermediate correlation states. Again, in simple cases, 
it is expected that G(t) should be significant only for 


T<t Ane? In these “generalized Boltzmann situations", 
Ouida sh Hs 
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to write an approximate Markoffian equation in place of 
eqns (b2776)"Cch. *Prigogine [54]}. 

The evolution equation (12.76) is completely 
genieral—dnd, "as a restrt. ts nota practical=too). "sin 
order to reduce it to a tractable equation, certain 
assumptions must be made. The first important assumption 
is that F(t) can be neglected for large times. This jis 
analagous to Bogolyubov's assumption that any initial 
correlations will be destroyed in a time of the order of 
the collision time and it restricts one to systems 
without "memory" effects. 

The second important assumption often made is 
that the general expression in (12.76) can be reduced to 
a Markoffian form. This requires that the change in PG 
due to transitions be negligible during a coliieon This 
may be expected to hold only in systems in which a short, 
well-defined collision time exists, thus excluding systems 
with long range interactions. 

It seems that, although tne Prigogine theory 
formulates dynamics of large systems directly in terms of 
correlations and thus makes possible explicit formal 
statements of the various assumptions about correlations, 
the assumptions necessary to derive useful results are 
very similar to those of other kinetic theories. This 


somewhat detracts from the generality of the theory since 
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it is generally very difficult to decide whether the 
assumptions made are satisfied ina given physical system. 
As a final example of the Prigogine method, the 
case of a one-dimensional anharmonic crystal will be 
considered (ci. Prigogine [51]). This example is easily 
generalized to three dimensions. The system consists of 
NW identical particles of mass m, spaced a distance "a" 
apart in the ground state. The potential energy associated 
with an arbitrary displacement of the particles from their 


ground state configuration may be written as 


1 N nN N 
B= Eats » A Ye OU ee y B bm Un 1 ee a5 
O 2 At hia y AU aL gL 6 Annie) ee eT 


C2 7a) 


where EY is the ground state energy and where the position 
x, of the nth particle 1s 


ke eina tego : G12-37.3)) 


The cubic and higher order terms in eqn. (12.77) 
are important in describing the evolution of the system to 
equilibrium since the quadratic term yields only non- 
interacting normal modes (phonons). 

The Hamiltonian of the system is 


: (ay)! (12.79) 
H = k on + ESEe) , : 
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In this case, instead of taking the free particle 
Hamiltonian as a starting point and regarding E-E as 
the perturbation, it is useful to include the quadratic 


(harmonic) part of eo, in HO: iiatcsisem let 


r gia a (12.80) 
n 


To find the corresponding Ly: use the well-known normal 


coordinate transformation 


ile sip (12.81) 
n k K 
with the periodic boundary condition Unen Uns This 
restricts’ k™to the values 
= mot aoe A 12.82 
k ay m(i5) c) (m p2s2295) ~ ( kd ) 


If action-angle variables (J, sa) ) are introduced, 
the Hamiltonian takes a simple form. The complex 
coordinates q, are related to the action-angle variables 


by e ° 
1a = L@e 
a 2(2nm) 26 (a, /ap)/2e KH fw) /%e 7} (12.83) 


and dy id Toy qr, Gizeos) 


where w, (= K) is the frequency of the normal mode k, 


defined by 
ik(n-n' ja (12.85) 
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With these definitions, 


H = 


0 : ok (12.86) 


which is the expected form for a collection of 
independent harmonic oscillators. 

The perturbation which will be considered is 
cme cubic term in eqn. (12.77). In terms of action-angle 
variables, this can be shown to be 

Oncaea 
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It is straightforward to recast the Liouville 
operator in terms of normal modes and action-angle 


variables (cf. Prigogine [51]). Doing so gives 
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The matrix elements of SZ are 


Cw 2T- 1.0 . Tate. 
] 7 vad jeved 
<{n}|6Z|{n'}>= Hite éLe day ++ da, 
v5 ena 


2291) 


The sets {n} denote the occupation numbers of the various 


normal modes. The only non-zero matrix elements are of 
the form 
<{n}sny npr snp [SL] {n} snp te snp ute Npute > ° (12.92) 


The matrix element (12.92) is referred to as a three 
phonon interaction. 

The equations for the Prk} can be solved by 
iteration, as in earlier discussions. If, in the weak 
coupling limit, only the lowest order non-vanishing terms 
are kept in the equation for Par then the important 


contribution is 
ipp(io) = <o[SZR,sZ[o> (12.93) 


This may be represented by the "three phonon vacuum-vacuum 


diagram" 


In this approximation, the equation for on is 


ae in“ (io), (t) : (12.94) 
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This is a Boltzmann equation for phonons and 
was first derived by Peierls (1929) using arguments 
Similar to those Boltzmann used for gases. It follows 
from the general evolution equation (12.76) by dropping 
all destruction terms and non-Markoffian effects and can 
only be valid for weak anharmonicities or short times. It 
describes an irreversible evolution to equilibrium and 
an H-theorem can be derived from it. 

This concludes the discussion of the Prigogine 
theory of. irreversible processes. Further examples 
and discussions can be found in the references (Prigogine 


[51] and [54], see also Jancel [42]). 
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